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MOTIVATION  FOR  THE  RESEARCH 


It  has  been  observed  that  the  process  of  choosing  among  multiattributed 
alternatives  often  involves  a  search  for  nondominated  alternatives,  alter¬ 
natives  which  are  not  worse  than  any  other  alternative  on  any  attribute  and 
which  are  better  than  each  other  alternative  on  at  least  one  attribute.  In 
most  decision  situations,  however,  there  is  more  than  one  nondominated  alter¬ 
native,  at  least  initially.  In  such  decision  situations,  the  decisionmaker 
typically  "adjusts"  the  structure  and  parameter  values  of  the  decision  situ¬ 
ation  such  as  to  identify  a  single  nondominated,  or  most  preferred  alter¬ 
native.  This  adjustment  may  involve  rational  activities,  such  as  aggregation 
of  attributes  and  compensatory  tradeoffs  through  determination  of  judgmental 
weights.  It  may  also  involve  various  rules  which  may  be  quite  flawed,  such  as 
lexicographic  ordering  in  which  the  best  alternative  on  the  most  important 
attribute  is  selected,  or  such  as  sequential  pairwise  comparison  of  alter¬ 
natives  using  a  preference  relation  that  is  a  function  of  the  two  alternatives 
being  compared. 

A  variety  of  wholistic,  heuristic,  or  holistic  judgmental  activities  will 
typically  be  involved  in  a  search  for  a  dominance  structure  among  the  alterna¬ 
tives.  Especially  when  there  are  a  large  number  of  alternative  courses  of 
action  under  consideration,  will  the  decision  process  typically  involve  mixed 
scanning,  in  which  some  noncompensatory  rule  is  first  used  to  eliminate 
grossly  inappropriate  alternatives.  This  is  then  followed  by  one  or  more 
compensatory  information  evaluation  operations  that  results  in  a  suitable 
dominance  structure  that  enables  final  selection. 


We  have  developed  a  knowledge  based  system  to  interactively  aid  planning 
and  decision  support  processes  through  encouragement  of  search  for  an  alter¬ 
native  dominance  structure  that  is  behaviorally  realistic  and  rational,  from 
both  a  substantive  and  procedural  viewpoint.  The  support  system  is  called 
ARIADNE  which  is  an  acronym  for  Alternative  Ranking  Interactive  Aid  (based  on) 
Dominance  (structural  information)  Elicitation.  The  support  system  enables 
use  of  various  integrated  forms  of  wholistic,  heuristic,  and  holistic  reason¬ 
ing  in  an  aided  search  for  dominance  information  among  identified  alter¬ 
natives.  It  is  believed  to  be  flexible  enough  to  closely  match  diverse 
decision  situations  and  environments  in  order  to  support  varying  cognitive 
skills  and  decision  styles;  thereby,  enabling  planners  and  decision  makers  to 
adapt  its  use  to  their  own  cognitive  skills,  decision  styles,  and  knowledge. 

Most  of  our  efforts  have  concerned  choice  making  situations  under  cer¬ 
tainty  and  under  risk  for  the  single  decision  epoch  case.  This  formulation 
allows  consideration  of  a  variety  of  imprecisely  known  parameters  such  as 
attribute  tradeoff  weights,  outcome  state  values  on  lowest  level  attributes, 
event  outcome  probabilities,  and  various  combinations  of  these.  Parameter 
needs  are  determined  from  the  structure  of  the  decision  situation  as  elicited 
from  the  decisionmaker  during  the  formulation  and  analysis  steps  of  the  deci¬ 
sion  support  process. 

The  decision  situation  structural  model  may  represent  decisions  under 
risk  or  under  certainty.  The  attribute  tree  representing  the  features  of 
decision  outcome  states  may  be  structured  and/or  parameterized  in  a  top-down 
or  bottom-up  fashion  through  use  of  ARIADNE.  A  single  level  structure  or  a 
multiple  level  hierarchical  structure  of  attributes  may  be  used  with  the 
choice  of  these  being  at  the  discretion  of  the  decisionmaker.  Multiple  deci- 


sion  node  situations  may  be  approaches  through  a  goal  directed  type  decision 
structuring  approach  in  which  the  growth  of  the  structure  of  alternative 
decisions  and  event  outcomes  is  guided  by  sensitivity  like  computations  ob¬ 
tained  through  use  of  the  ARIADNE  algorithms. 

Parameters  are  elicited  from  the  decisionmaker  in  the  form  of  equalities 
and  ratio  inequality  bounds.  A  variety  of  mathematical  programming  approaches 
and  graph  theory  have  been  used  to  generate  interactive  displays  of  preference 
digraphs.  The  mathematical  programming  approaches  are  used  to  determine 
dominance  structures  for  alternative  prioritization  that  are  based  on  para¬ 
meter  information  elicited  from  the  decisionmaker.  At  present,  only  a  linear 
programming  approach  yields  a  dominance  structure  on  the  alternatives,  rather 
than  bounds  on  such  a  structure,  in  computational  times  that  are  consistent 
with  real  time  interactive  decision  aiding. 

The  purpose  of  the  graph  theory  algorithms  is  to  enable  construction  of  a 
domination  digraph,  or  dominance  structural  model,  of  preferences  that  are 
based  upon  a  dominance  reachability  matrix  determined  by  the  linear  program¬ 
ming  algorithms  from  the  decision  situation  structural  model  and  parameters 
elicited  from  the  decisionmaker.  These  preference  digraphs  or  dominance 
structural  models  encourage  either  selection  of  a  preferred  alternative,  or 
further  iteration  using  the  aggregated  preference  information  for  feedback 
learning. 

An  inverse  aiding  feature  has  been  incorporated  into  the  decision  support 
system.  In  this  approach,  the  decisionmaker  makes  a  wholistic  prioritization 
among  alternatives.  This  prioritization  may  be  across  some,  or  all,  ident¬ 
ified  alternatives;  and  at  the  top  level  of  the  hierarchy  of  attributes,  or  at 
some  intermediate  level.  If  we  assume  that  numerical  bounds  on  the  attribute 


scores  for  those  attributes  subordinate  to  and  included  within  the  attribute 
at  which  alternatives  are  prioritized,  then  bounds  on  attribute  weights  may  be 
determined  that  are  consistent  with  the  wholistic  prioritization  by  using  a 
linear  programming  approach.  If  weights  are  specified,  then  it  is  possible  to 
determine  bounds  on  alternative  scores  on  those  attributes  subordinate  to  the 
attribute  at  which  prioritization  was  made  through  use  of  linear  programming 
algorithms . 

As  alternatives  are  identified  and  prioritized,  updates  on  these  bounds 
are  made  available.  The  results  obtained  from  using  the  inverse  aiding  fea¬ 
ture  are  comparable  in  concept  to  those  obtained  from  the  regression  analysis 
based  Social  Judgement  Theory,  which  results  in  weight  identification  only, 
except  that  results  in  the  form  of  bounds  on,  or  ranges  of,  weights  are  avail¬ 
able  with  a  very  few  alternative  prioritizations.  For  a  large  number  of 
prioritizations,  the  inverse  aiding  approach  will  become  cumbersome  computa¬ 
tionally  compared  to  the  regression  based  approach  where  additional  informa¬ 
tion  may  be  processed  in  a  sequential  fashion.  Implementation  of  the  combi¬ 
nation  of  inverse  and  direct  aiding,  to  enhance  decisionmaker  specification  of 
imprecise  values  weights  and  probabilities,  will  enhance  the  usefulness  of 
ARIADNE  through  encouragement  to  the  decisionmaker  to  become  more  aware  of 
relevant  alternative  courses  of  action  and  to  identify  new  alternatives  on  the 
basis  of  feedback  learning  of  the  impacts  of  alternatives  upon  issues  and 
objectives  in  a  behaviorally  relevant  way  that,  hopefully,  encourages 
learning. 


There  have  been  many  realistic  paradigms  of  the  process  of  judgment  and 
choice.  We  believe  that  the  dominance  process  model  described  here  it  not 
inconsistent  with  the  primary  features  and  intensions  of  these.  Our  purpose, 
however,  is  to  develop  a  conceptual  design  for  a  prescriptive  approach  to 
judgment  and  choice  that  will  aid  in  the  search  for  better  decisions.  We 
recognize  that  a  truly  rational  approach  to  prescriptive  decisionmaking  must 
be  cognizant  of  the  process  of  decisionmaking,  that  is  to  say  process  ration¬ 
ality,  or  it  will  not  be  possible  to  evolve  substantively  rational  support 
systems . 

It  is  important  that  an  appropriate  decision  support  system  be  capable  of 
assisting  the  decisionmaker  through  encouragement  of  full  information  acquisi¬ 
tion,  including  that  which  may  disconfirm  strongly  held  beliefs,  and  in  the 
analysis  and  interpretation  of  this  information  such  as  to  avoid  a  variety  of 
cognitive  biases  and  poor  information  processing  heuristics  that  may  lead  to 
flawed  judgment  and  choice.  Several  desiderata  follow  from  this  and  these 
have  been  incorporated  in  ARIADNE. 

We  allow  for  top-down  or  bottom-down  structuring  of  the  attributes  of 
outcomes  or  impacts  of  decisions.  The  "tree"  or  "hierarchy"  of  attributes  may 
be  structured  to  the  depth  believed  appropriate  by  the  decisionmaker.  We 
encourage  indentif ication  of  alternative  courses  of  action,  additional  attri¬ 
butes  of  decision  outcomes,  and  revisions  to  previously  obtained  elicitations, 
at  any  point  in  the  decision  support  process  as  awareness  of  the  decision 
situation  and  its  structure  grows  through  use  of  the  support  system.  We  do  not 
force  a  person  to  quantify  parameters  to  the  extent  that  this  becomes  overly 
stressful,  or  behaviorally  and  physically  irrelevant  in  view  of  inherent 
uncertainties  or  imprecision  associated  with  the  knowledge  of  parameters 
characterizing  the  decision  situation  structural  model. 


We  allow  for  revision  in  the  elicited  structure  of  the  decision  situation 
and  for  the  identification  of  new  options  as  awareness  of  the  decision 
situation  grows.  Also,  we  do  not  require  the  decisionmaker  to  quantify  para¬ 
meters  beyond  the  level  felt  appropriate  for  the  situation  at  hand.  ARIADNE 
allows  parameter  imprecision  to  satisfy  this  quantification  relevancy  require¬ 
ment.  We  encourage  the  decisionmaker  to  specify  numerical  ranges  for  facts 
and  values.  Thus  we  allow,  for  example,  expressions  for  alternative  (A) 
scores  on  attributes  (i)  in  a  form  such  as  0.2  <  v^(A)  <  0.5.  Weights  asso¬ 
ciated  with  attribute  i  might  be  expressed  in  the  form  0.2  <  w^  <  0.4  and  the 
probability  of  event  (i)  might  be  stated  in  the  form  0.3  <  P^(A)  <0.45.  We 
allow  ordinal  representations  in  the  linear  forms  v^(A)  <  v^(B)  <  v^(C),  2w^  < 
Wj  <  w^,  Pj(A)  <  P^(A)  <  3P^(A),  or  in  similar  forms.  Quantification  of 
imprecision  in  the  form  of  numerical  bounds  on  parameters  is  thus  constrained 
such  that  it  will  always  lead  to  what  we  call  behaviorally  consistent  infor¬ 
mation  sets.  Sometimes  totally  ordinal  information  may  need  further  quantifi¬ 
cation  in  order  to  make  the  precision  and  rigidity  of  the  mathematics  corre¬ 
spond  to  the  intensions  of  the  decisionmaker  in  making  an  ordinal  specifi¬ 
cation.  This  is  generally  not  needed  to  obtain  solutions  but,  rather,  to 
obtain  parametric  models  that  are  faithful  to  the  understandings  of  the 
decisionmaker.  For  example  that  ordinal  alternative  score  inequalities  v^(A) 
<  v^(B)  <  v^(C)  are  satisfied  by  the  relations  0  <  v^(A)  <  l-2e,  w  <  v^(B)  < 
1-e,  2w  <  v^(C)  <  1  for  small  positive  e  and  w  which  in  the  limit  become  zero. 
It  will  generally  not  be  the  case  that  the  decisionmaker  would  express  this 
much  imprecision,  and  would  wish  to  see  it  more  fully  quantified. 


Considerable  effort  was  devoted  to  an  operational  evaluation  of  ARIADNE. 
The  results  of  this  evaluation,  as  well  as  the  detailed  results  of  the  various 
positions  of  this  three  year  research  contract  are  contained  in  the  appendix 
to  this  final  report  which  consists  of  reprints  of  papers  published  under  the 


subject  contract. 
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Structured  Policy  Results  for  Single  Stage 
Decisionmaking  under  Uncertainty 

CHELSEA  C.  WHITE,  III,  member,  ieee 

Ahstra——  A  f'.rte-deprndent  stifle-  dtdrioo  nnih'sli  prubletn  is 
j  examined  where  the  set  of  underlying  states  of  nature  and  the  set  of 
i  available  actions  are  both  partially  ordered.  Conditions  on  the  preference 
structure  are  presented  which  guarantee  that  the  optimal  policy  is  mono- 
tottieally  nondecreasing  in  the  density  vector  over  the  state  set.  This 
Intuitively  desirable  functional  form  is  also  shown  to  be  inherited  by  the 
nondotniaated  policies  for  the  vector  criterion  case. 

I.  Introduction 

The  view  that  a  wide  variety  of  decisionmaking  situations  can 
be  adequately  modeled  as  single-stage  decisionmaking  problems 
under  uncertainty  has  served  as  justification  for  the  development 
.of  several  decision  aids  based  on  a  decision  tree  comprised  of  a 
•  single  decision  node  [1],  [3J-[5].  Results  presented  in  [I],  [3]-[5] 
have  demonstrated  an  awareness  of  the  usefulness  and  intuitive¬ 
ness  of  opumal  policy  structure  for  decision  problems  modeled 
^  by  single  stage  decision  trees.  These  efforts,  however,  have  not 
utilized  established  ana  more  general  results  founa  primarily  in 
the  operations  research  literature  for  determining  conditions 
sufficient  for  the  existence  of  optimal  policies  having  attractive 
functional  forms. 

In  this  correspondence,  we  exploit  results  found  in  [6]  in  order 
to  determine  constraints  on  the  preference  structure  which 
guarantee  that  the  optimal  policy  has  an  intuitively  desirable 
*“  functional  form  for  an  important  class  of  decision  analysis 
problems.  These  results,  plus  those  found  in  [2],  are  then  used  to 
-  show  that,  for  the  vector  criterion  extension,  the  search  for 
ncndomicated  policies  can  be  restricted  to  the  set  of  all  policies 
.  possessing  this  intuitively  desirable  functional  form.  We  now 
present  two  examples  which  have  motivated  this  research. 

Example  1  (Military  Decisionmaking  [/],  [3]j 

Assume  the  state  of  the  enemy's  intent  can  be  any  of  the 
following: 

1)  engage  in  routine  surveillance, 

2)  fully  prepare  to  attack,  stopping  short  of  attack,  or 
i  3)  commit  a  hostile  action. 

I . 
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The  options  assumed  available  to  the  commanding  officer  are 

1)  continue  routine  operations  (appropriate  for  state  1), 

2)  divert  effort  from  other  concerns  to  prepare  for  attack 
(appropriate  for  state  2),  or 

3)  divert  effort  from  other  concerns  and  attack  (appropriate 
for  state  3). 

We  assume  that  significant  disbenefits  may  accrue  if  the  ap¬ 
propriate  option  is  not  instituted.  Let  xt  be  the  probability  that 
the  state  of  enemy  intent  is  i.  It  seems  intuitively  reasonable  that 
the  smaller  x3  becomes  and  the  larger  x,  gets,  the  smaller  the 
option  number  selected  should  be. 

Example  2  (Patient /Physician  Interaction  [d],  [5]j 

Assume  a  patient  can  be  in  one  of  three  different  states  of 
health: 

1)  well, 

2)  has  the  disease,  or 

3)  has  a  severe  form  of  the  disease. 

Three  therapies  are  assumed  available  to  the  physician: 

1)  do  nothing  (appropriate  for  the  well  state  of  health), 

2)  drug  regimen  (appropriate  for  the  “disease”  state  of 
h'lalth)  7r 

3)  surgery  (appropriate  for  the  “disease  with  complications” 
state  of  health). 

We  assume  that  if  the  appropriate  therapy  is  not  selected, 
disbenefits  such  as  risk  of  complications  may  result.  Once  again, 
it  seems  reasonable  that  the  lower  the  probability  of  being  in 
state  of  health  3  and  the  higher  the  probability  of  being  in  state 
of  health  1,  the  smaller  the  therapy  number  should  be. 

This  correspondence  is  organized  as  follows.  Section  II  defines 
the  scalar  criterion  decision  problem.  A  precise  definition  of  a 
monotonically  nondecreasing  policy  is  presented  in  Section  III. 
Conditions  are  given  which  guarantee  that  the  optimal  policy 
has  this  intuitively  desirable  functional  structure.  Section  IV 
considers  the  vector  criterion  extension  of  the  problem  for¬ 
mulated  in  Section  II,  and  provides  two  nondominated  struc¬ 
tured  policy  results  that  appear  to  have  potential  use  in  group 
decisionmaking  situations.  Section  V  summarizes  the  results 
determined  and  discusses  a  oehaviorally  relevant  issue  that  sug¬ 
gests  a  potential  impact  of  these  results  on  utility  assessment. 

II.  Problem  Statement 

Let  5  be  the  (finite)  set  of  all  states  that  the  system  can 
assume.  We  assume  that  S  is  partially  ordered  by  the  relation 
<r.  For  example,  in  the  context  of  Example  1,  s<ss’  might 
have  the  meaning  that  state  of  enemy  intent  s  is  less  hostile  than 
state  of  enemy  intent  s';  thus  (intent  I)<^(intent  2)  and  (intent 
2)  <  s(intent  3). 

Let  A  be  the  (finite)  set  of  all  actions  available  to  the  de¬ 
cisionmaker.  Similarly,  assume  that  A  is  partially  ordered  by  the 
relation  <a ■  Again,  in  the  context  of  Example  1,  a<,Aa'  might 
have  the  interpretation  that  option  a  is  less  provoking  than 
option  a',  and  hence  (option  1)<  ^(option  2)  and  (option  2) 
<  ^(option  3). 

Uncertainty  is  described  by  a  probability  density  vector,  x  — 
{x,},eJ.  over  the  state  space;  i.e.,  x,  is  the  probability  that  the 
state  of  the  system  is  sES.  Note  that  xEX,  where  X—  {x  —  {x,}: 
x,  >  0  (or  sES  and  Z,e5x,  “  1}- 

We  remark  that  <  s  induces  a  partial  order  on  X  in  the 
following  way.  A  subset  KcS  is  said  to  be  increasing  if  re  A  and 
s  <ss'  implies  that  s'EK.  Thus  if  5“  i),  then  increasing 

subsets  of  S  are  of  the  form  {»,/+!,-•  •  ,s).  We  say  x  < xx'  if 
and  only  if  S,EXx,  <  2,6*x;  for  all  increasing  subsets  K. 
Observe  that  for  the  case  where  5  is  totally  ordered,  x<*x’  if 
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and  only  if  the  cumulative  distribution  function  associated  with 
x'  bounds  the  cumulative  distribution  function  associated  with  x 
from  above.  With  reference  to  Example  1,  note  that  x<Ax'  is 
equivalent  to  x5  and  x2  +  x3  <  x2  +  xj,  and  thus  x  repre¬ 
sents  an  intuitively  less  hostile  description  of  state  uncertainty 
than  does  x‘. 

Assume  that  U:  XXA-+R  is  a  given  quantitative  measure  of 
preference.  That  is,  lf(x,  a)>  U(x\  a')  if  and  only  if  the  density 
vector  x  and  action  a  are  more  preferred  to  the  density  vector  x’ 
and  action  a'.  For  example,  t/(x,a)— St€fx,u(s,a),  where 
u(s,  a)  is  the  utility  of  being  in  state  s  and  applying  action  a  and 
where  preference  is  assumed  to  be  described  by  expected  utility. 

The  objective  of  the  decision  problem  modeled  as  above  is  to 
determine  an  action  for  each  xEX  which  maximizes  U(x,a). 
That  is,  we  wish  to  determine  an  action  selection  rule,  or  policy, 
6:  X-*A,  which  attains  the  maximum  in  ma xaeAU(x,a)  on  X. 

III.  Results — Scalar  Criterion  Case 

The  intent  of  this  section  is  to  present  conditions  on  U  which 
imply  that  a  maximizing  policy  S  exists  which  has  the  following 
property : 

x<*x'  implies  5(x)<^5(x'). 

We  will  refer  to  such  a  policy  as  an  isotone  (monotonically 
nondecreasing)  policy.  Note  that  in  Examples  1  and  2  it  was 
argued  that  an  optimal  po'icv  should  intuitively  possess  this 
isotone  property.  We  now  present  conditions  on  U  which 
guarantee  that  an  optimal  policy  can  be  found  which  is  isotone. 

Theorem  (Topkis):  Assume  U  is  such  that  if  x<  jrx'  and  a 
<Aa\  then 

U(x,  a)+U(x',  a')  >U(x,a')  +  U(x',a). 

Then  there  exists  an  optimal  policy  which  is  isotone. 

The  above  property  on  U  is  often  referred  to  as  the  supermodu - 
larity  property  (6J.  This  property  suggests  that  on  average  the 
“poorly  matched”  pairs  (x,  o')  and  (x',  a)  are  less  preferable  to 
the  relatively  well  matched  pairs  (x,a)  and  (x't  o').  For  more 
discussion,  see  (6]. 

Proof:  Assume  that  for  xSX,  a<Aa'  and  t/(x, o')  — 
t/(x, o)> 0.  If  x < xx ',  then  the  supermodularity  property  im¬ 
plies  l/(x\  o')  -  l/(x',  o)  >  U(x,  a')-U(x,  o)  >0.  thus  guaran¬ 
teeing  the  existence  of  an  optimal  policy  which  is  isotone.  A 
ge’  eralirjtion  of  t’tis  result  .s  presented  in  [6].  Q.E.D. 

The  following  result  gives  conditions  which  guarantee  that  an 
isotone  policy  exists  for  the  case  where  U  is  linear  in  x,  e.g.,  U  is 
an  expected  utility  function. 

CoroUaiy  1:  Assume  that  C/(x,  o)-2,6sJt»“(f- a)  ud  that  u: 
SxA-*R  is  such  that  if  r<rr'  and  a  <Aa\  then 

u(s,o)  +  w(j',o')>u(s,o')  +  u(j',fl). 

Then  there  exists  an  optimal  policy  which  is  isotone.  Proof  of 
this  result  requires  the  following  Lemma. 

Lemma:  Let  /:  S-*R  be  isotone  on  S;  i.e.,  assume  s  <  si' 
implies  /(s)</(r').  Then  x<xx'  implies  that  2,x,/(r)< 
2,x;/(s). 

Proof:  Note  that  since  /  is  nondecreasing,  it  can  be  ex¬ 
pressed  as  /(•r)“Z*-a*7yr(.r),  where  aK  >0  for  all  K^S,K  is 
increasing,  and  /A-(r)— 1(0)  if  s£K(sG.K).  Then  2,*,/(r)“ 
2tx,2AaA/A(r)"2AaA2,x,/A(s)  —  2AaAXj6Ax,  <  ZAaA 

2,6*x;«2,x;/(j).  Q.E.D. 

Proof  of  Corollary  I:  We  now  show  that  the  supermodular¬ 
ity  of  u  on  SxA  implies  the  supermodularity  of  U  on  Xx  A.  The 
result  then  follows  from  the  Theorem. 

Note  that  the  supermodularity  of  u  implies  that  u(-,o')— 
“(•, o):  S-*R  is  nondecreasing  on  5  if  a<Aa'.  It  then  follows 
from  the  Lemma  and  the  linearity  of  U  in  x  that 

2)x,u(j,a')-  2 *>(*.«')-  '2x',u(s,a), 

III! 

which  implies  that  Uis  supermodular.  Q.ED. 


Fig.  1.  Probability  triangle  and  optimal  policy  tor  Example  3. 

Corollary  1  implies  that  if  the  utility  function  assessed  is  not 
supermodular,  then  the  optimal  policy  may  not  be  isotone.  We 
now  present  an  example  where  an  isotone  optimal  policy  ap¬ 
pears  desirable,  the  utility  structure  possesses  several  agreeable 
characteristics  (one  of  which  is  not  supermodularity),  but  the 
optimal  policy  is  not  isotone. 

Example  3 

Astv-te  that  (/(;■.,  a)— 2,x,u(i,u)  for  Example  i  and  that 
u(s,  a)  has  the  following  assessed  values: 

«(1,1)-100  «(l,2)-30  u(l,3)-5 
u(2,l)-25  u(2,2)~50  «(2,3)-15 

u(3,l)-0  u(3,2)-10  u(3,3)-25. 

Note  that  u(s,  a)  has  several  desirable  functional  characteristics: 

1)  «(»,y)  is  antitone  (monotonically  nonincreasing)  in  |f-yj 
(the  more  that  we  underreact  or  overreact,  the  less  desira¬ 
ble  is  our  response); 

2)  u(i,  i)  >  u(i\ »')  for  i  <  /'  (a  more  peaceful  world  is  more 
desirable); 

3)  »(r, a')>u(s',a)  for  s<s'  and  a<<j'  (it  is  better  to 
oveneact  than  to  underreact); 

4)  i.(2, 1)>  u(3,3)  and  i»(l,2)  >  u( 3,3)  (mild  forms  of  overre¬ 
action  and  underreaction  are  better  than  war). 

Observe,  however,  that  u  is  not  supermodular  since  neither 
u(-,2)— u(-,  I)  nor  u(-,3)-u(-,2)  is  nondecreasing.  Fig.  1  pre¬ 
sents  the  probability  triangle  with  appropriately  marked  regions 
where  the  various  options  are  optimal. 

We  remark  that  for  this  example  the  optimal  policy  is  not 
isotone.  To  show  this,  let  x— (0.150, 0.170,  0.680)  and  x'  — (0.010, 
0.305,  0.685).  Observe  that  x'  represents  a  more  hostile  descrip¬ 
tion  of  enemy  intent  than  does  x  in  that,  although  xj  is  only 
marginally  larger  than  x2,x'2+x2  is  substantially  larger  than 
x2  +xj,  and  thus  x<xx'.  It  is  easily  shown,  however,  that  the 
optimal  action  for  x  is  option  3,  and  the  optimal  action  for  x'  is 
option  2.  A  seemingly  reasonable  utility  function  has  therefore 
induced  an  optimal  policy  with  an  intuitively  undesirable  (per¬ 
haps  untrustworthy)  characteristic.  Note  the  optimal  policy  asso¬ 
ciated  with  the  weather  tnangle  on  13,  p.  27)  for  a  similar 
contradictory  result. 

IV.  Results— Vector  Criterion  Case 

We  now  assume  that  the  preference  measure  function  U  is 
vector  valued;  i.e.,  assume  U:  X  x  A -*  R* ,  U(x,  a)  ~ 
[Ut(x,a),-  ,Uh(x,  a)).  The  intent  of  using  a  vector  criterion 
is  that  the  scalar  elements  of  U  represent  quantitative  measures 
of  noncommensurate  preferences.  A  motivating  example  is  now 
presented. 
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Example  4 


Assume  the  utility  functions  for  two  different  military  de¬ 
cisionmakers  have  been  assessed  for  the  decisionmaking  prob¬ 
lem  presented  in  Example  1,  and  let  um  be  the  utility  function  of 
the  mth  decisionmaker,  m-  1.2.  The  objective  of  the  analyst  is 
to  negotiate  a  single  group  policy;  however,  the  two  utility 
functions  generate  two  different  optimal  policies. 

The  intent  of  this  section  is  to  provide  guidance  to  the  analyst 
in  his  or  her  efforts  to  determine  a  negotiated  policy.  A  natural 
starting  point  is  to  restrict  the  negotiations  to  the  set  of  all 
nondominated  policies,  which  we  now  define. 

We  say  that  a  policy  6  is  dominated  if  and  only  if  there  exists  a 
policy  S'  which  satisfies  the  following  property:  Um(x,  6(x))  < 
U„(x,  S'(x))  for  all  xeX  for  each  m**  !,•••,  M  and  for  some  x 
and  m,  Un(x,  S(x)) <  Um(x,  S'(x)).  A  nondominated  policy  is  not 
dominated.  Observe  that  if  a  policy  is  dominated,  there  exists 
another  policy  which  is  at  least  as  good  as  the  dominated  policy 
for  all  scalar  elements  of  the  preference  measure  function.  Thus, 
in  the  context  of  Example  4,  it  seems  quite  natural  for  the 
analyst  and  the  decisionmakers  to  agree  that  only  nondominated 
policies  should  be  considered  in  seeking  a  single  negotiated 
policy. 

Assume  throughout  the  remainder  of  this  section  that  U(x,  a) 
“2.esX,u(*.").  where  u(s.  a)- {ti,(s,  a),- •  ■ ,  uM(s,  a)}.  It  is 
demonstrated  in  [2]  that  if  a  policy  S  causes  the  maximum  to  be 
attained  on  X  for  the  criterion 

M 

max  2  *,  2  (1) 

aeA  ses  m- l 

for  some  a-{a„}  such  that  am>  0  for  all  m,  then  S  is  a 
nondominated  policy.  Observe  that  it  is  sufficient  to  consider 
only  those  a6i,  where  &—{aeRM:  a„>0  for  all  m  and 
1mam  -  1).  Determination  of  all  (nonrandom)  nondominated 
policy  requires  consideration  of  all  aSffi.  We  now  can  state  a 
structured  policy  result  for  nondominated  policies. 

Corollary  2:  Assume  um:  SxA—>R  is  supermodular  for  all 
m«l,-  •  ■ ,  M.  Then,  search  for  the  set  of  all  nondominated 
policies  can  be  restricted  to  the  set  of  isotone  policies. 

Corollary  2  states  that  in  the  context  of  Example  4,  if  both 
decisionmakers  have  utility  structures  which  imply  the  existence 
of  optimal  isotone  policies  and  if  they  have  agreed  to  limit  their 
negotiations  for  seeking  a  group  policy  to  tne  set  of  non¬ 
dominated  policies,  then  they  can  restrict  their  attention  to 
isotone  policies.  Such  a  result  is  perceived  as  intuitively  desira¬ 
ble;  if  the  optimal  policy  for  each  decisionmaker  is  isotone,  then 
the  group  policy  should  also  be  isotone. 

Proof  of  Corollary  2:  The  proof  results  from  the  fact  that  the 
sura  of  nonnegatively  weighted  supermodular  functions  is  super- 
modular  and  from  application  of  the  Theorem.  Q.E.D. 

The  fact  that  the  criterion  in  (1)  is  isotone  in  U(x,a )  (in  fact 
linear  in  a)  implies  the  following  interesting  (and  trivially  proved) 
structured  policy  result. 

Corollary  3:  Assume  that  /:  RM—*R  is  isotone  and  that  xS 
X,  a’  eA  is  such  that  Um(x,  a‘)  >  Um{x,a)  for  all  aEX.  for  each 
m-l.  -.A/.  Then. /[(/(*, a*)l >/[£.'(*,  *)]  for  all  aeA. 

Corollary  3  states  in  the  context  of  Example  4  that  if  all  the 
decisionmakers  agree  on  an  action  for  a  given  point  in  X,  then  it 
is  not  restrictive  to  assume  that  the  group  policy  should  also 
select  that  action  for  the  given  point.  We  remark  that  the 
function  /  in  Corollary  3  is  often  called  a  social  choice  function,  a 
function  that  trades  off  the  measures  of  the  various  noncom- 
mensurate  objectives.  Corollaries  2  and  3  are  illustrated  in  the 
following  example. 

Example  5 

With  reference  to  Example  4,  assume  the  utility  functions  lor 
decisionmakers  1  and  2  are  given  in  Table  I.  We  seek  the  set  of 
all  nondominated  policies  in  order  to  focus  the  determination  of 
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Utility  Functions  for  Example  5 
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Fig.  2.  Optimal  policy  for  DM1  for  Example  5. 
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Fig.  4.  Characterization  of  nondominated  policies  for  Example  S. 

a  group  policy.  Figs.  2  and  3  present  the  optimal  policies  for 
decisionmakers  I  and  2,  respectively.  Corollary  2  implies  that 
since  the  utility  structures  given  in  Table  I  are  both  supermodu¬ 
lar,  search  for  a  group  policy  can  be  restricted  to  the  set  of 
isotone  policies.  Corollary  3  implies  that  the  decisionmakers  can 
restrict  their  negotiations  to  determining  the  action  associated 
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Fig.  7.  Nondominated  policy  for  Example  5,  a  «0.75. 

with  the  group  policy  in  the  areas  marked  "1  or  2”  and  “2  or  3” 
in  Fig.  4;  the  areas  marked  “1,”  “2,”  and  “3”  designate  areas  of 
the  probability  triangle  where  both  decisionmakers  agree  as  to 
the  best  action.  The  linear  nature  of  the  criterion  given  in  (1) 
indicates  that  the  lines  separating  the  various  regions  of  the 
probability  triangle  for  the  nondominated  policies  will  be  linear 
combinations  of  the  lines  separating  the  various  regions  of  the 
probability  triangle  associated  with  each  decisionmaker.  Three 
example  nondominated  policies  are  displayed  in  Figs.  5-7  for 
various  values  of  a-a2(a,  -  1  -a). 

V.  Conclusion 

This  correspondence  has  considered  a  state-dependent  single- 
stage  decision  analysis  problem  with  partially  ordered  state  and 
action  spaces.  The  partial  order  on  the  state  space  was  used  to 
induce  a  partial  order  on  the  space  of  all  probability  density 


vectors  over  the  state  space.  It  was  shown  that  if  the  preference 
structure  is  supermodular,  then  there  exists  an  optimal  policy 
which  is  isotone  on  the  probability  density  space.  For  the  vector 
criterion  case,  we  showed  that  if  each  scalar  element  of  the 
criterion  is  supermodular,  then  it  is  sufficient  to  search  only  the 
isotone  policies  in  order  to  determine  nondominated  policies. 

We  believe  that  the  results  contained  in  this  correspondence 
are  of  importance  for  the  following  behaviorally  relevant  rea¬ 
sons.  A  (statistically  insignificant)  number  of  subjects  were  asked 
to  consider  the  statement  of  Example  1.  All  agreed  that  an 
optimal  policy  should  be  isotone.  The  utility  structures  assessed, 
however,  almost  invariably  produced  nonisotone  policies.  For 
these  cases,  when  confronted  with  the  fact  that  their  utility 
structure  generated  a  nonisotone  policy,  each  subject  felt  that 
isotonicity  was  still  a  characteristic  that  the  optimal  policy 
should  possess,  and  hence  the  utility  structure  assessed  must 
represent  an  inaccurate  quantification  of  his  preferences.  These 
facts  generate  the  following  hypothesis:  the  isotonicity  of  the 
optimal  policy  is  not  (implicitly)  captured  by  any  of  the  com¬ 
monly  applied  utility  assessment  procedures.  Given  that  this 
hypothesis  is  true,  it  would  therefore  seem  appropriate  for  the 
analyst  to  affect  the  assessment  procedure  so  that  the  optimal 
policy  would  be  isotone,  e.g.,  explicitly  require  that  the  assessed 
utility  structure  be  supermodular. 
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On  the  Choice  of  a  Military  Transport  Aircraft  Fleet 
via  Worth  Assessment  Procedure:  A  Case  Study 

KEVIN  Y.  K.  NG 

Abstract — A  model  is  developeJ  to  guide  the  military  planners  on  the 
choice  of  a  new  military  transport  aircraft  fleet  for  Canada.  It  discusses  the 
fleet  problem  in  light  of  the  satisfaction  of  military  requirements,  the 
maximization  of  industrial  benefits,  and  the  minimization  of  operating 
costs.  The  aircraft  capability  of  the  fleet  is  obtained  by  means  of  simula¬ 
tion.  Worth  assessment  procedure  Is  then  employed  to  establish  a  prefer¬ 
ence  relationship. 

Introduction 

Commencing  sometime  in  the  1980's  Canada  will  need  a  new 
transport  aircraft  to  replace  its  present  strategic/tactical  fleet.  It 
is  expected  that  the  aircraft  fleet  will  be  required  to  carry  out 
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On  the  application  of  multiple  criteria  decision  making  to  a 
problem  in  defence  systems  acquisition 

AARON  R.  DEWISPELAREfJ  and  ANDREW  P.  SAGEf 


Multiple  criteria  decision  theory  (MCDT)  approaches  to  choice  making  are  receiving 
increased  attention  due  to  the  increasing  importance  society  places  on  incorporating 
the  non-commensurate  and  conflicting  objectives  of  a  situation  into  the  choice  making 
process.  Process  algorithms  for  multiple  objective  optimization  theory  (MOOT)  and 
multiple  attribute  utility  theory  (MAUT)  motivated  a  combined  approach  which 
utilizes,  in  an  efficient  manner,  the  complementary  aspects  of  both  processes.  An 
appropriate  application  for  the  multiple  criteria  approach  is  a  specific  military 
equipment  acquisition  involving  aircraft  retrofit.  The  retrofit  of  a  particular  aircraft 
with  equipment  designed  for  a  mission  which  the  aircraft  was  not  originally  designed 
to  fly  typically  requires  a  large  systems  effort.  Specifically,  the  retrofit  of  an  aircraft 
with  sophisticated  electronic  warfare  (E\V)  equipment  has  historically  involved 
inefficiencies  and  inadequacies  including  schedule  and  budgetary  overruns  and  a  lack 
of  initially  specified  final  product  performance.  Development  of  a  useful  combined 
MOOT/M AUT  process  seems  a  logical  choice  to  ameliorate  the  difficulties  of  current 
electronic  warfare  aircraft  retrofit  design  (EVVARD)  processes.  This  paper  generates 
a  set  of  criteria  for  evaluation  of  alternative  retrofit  systems  in  the  defence  systems 
acquisition  cycle  and  develops  an  efficient  framework  for  EVVARD  through  extension 
of  a  MCDT  approach  for  this  application. 


1.  Introduction 

The  retrofit  of  a  particular  aircraft,  with  equipment  designed  for  a  mission 
the  aircraft  was  not  originally  intended  to  fly,  is  a  complex  and  time  consuming 
process.  When  U.S.  Air  Force  requirements  for  a  special  purpose  aircraft 
(electronic  warfare,  reconnaissance,  etc.)  are  developed,  there  is  generally  a 
concerted  effort,  for  economic  reasons  and  reasons  of  time  to  completion  of 
effort,  to  modify  an  existing  airframe  as  opposed  to  designing  an  entirely  new 
one.  Difficulty  arises  concerning  how  to  fit  a  wide  variety  of  equipment  into 
an  airframe  and  also  satisfy  all  concerned  parties  with  respect  to  cost,  per¬ 
formance,  and  schedule  (USOMB  1976;  USAF  1976  b).  Previous  efforts  at 
Electronic  Warfare  Aircraft  Retrofit  Design  (EWARD)  have  met  with  limited 
success  (Peterson  el  al.  1975  ;  Cook  1977).  The  basic  problem  is  that  the 
retrofit  aircraft  is  often  not  what  the  users  originally  asked  for  or  need. 
Instead,  the  retrofit  generally  results  in  an  aircraft  which  often  does  not 
sufficiently  ameliorate  deficiencies  which  led  to  the  design  requirement.  A 
combination  of  budgetary,  political  and  technical  factors  often  leads  to  system 
development  delays.  This  often  results  in  a  system  being  developed  in  a  later 
time  frame  than  the  one  in  which  it  was  needed  and  the  one  in  which  design 
requirements  were  specified. 

Current  directives  (USOMB  1976,  USDOD  1977  a,  USAF  1977  a,  USAF 
1976  a)  stress  the  incorporation  of  the  systems  oriented  approach  and  evaluation 
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criteria  concerning  performance,  cost  and  schedule.  As  stated  in  DOD 
Directive  5000.1:  “System  development  shall  be  continuously  evaluated 
against  these  requirements  (programs  and  equipment  which  exhibit  timely 
development  and  high  performance  at  a  minimum  cost)  with  the  same  rigor 
as  that  applied  to  technical  requirements.  Practical  trade-offs  shall  be  made 
between  system  capability,  cost  and  schedule.”  There  are  many  obstacles  to 
implementing  the  spirit  of  these  current  directives  as  will  be  described  in  §  2 
of  this  paper. 

The  purpose  of  this  effort  is  to  illustrate  how  multiple  criterion  decision 
theory  (MCDT)  can  be  applied  to  the  specific  application  area  of  an  initial 
phase  of  the  DOD  Equipment  Acquisition  Cycle  for  an  electronic  warfare 
aircraft  retrofit  design  (EWARD).  A  combined  multiple  objective  optimiza¬ 
tion  theory/multiple  attribute  utility  theory  (MOOT/MAUT)  approach  is 
applied  to  EWARD  to  investigate 

(1)  If  a  multiple  criteria  decision  theory  (MCDT)  approach  can  improve 
the  EWARD  process. 

(2)  If  application  of  a  combined  approach  using  both  MOOT  and  MAUT 
has  merit. 

(3)  If  an  adequate  set  of  criteria  can  be  generated  to  judge  the  goodness  of 
alternative  designs  early  in  the  EWARD  process. 

The  retrofitting  of  a  special  purpose  EW  aircraft  is  a  large-scale  system 
problem  because  of  the  political,  military,  economic,  and  technical  overtones. 
EWARD  requirements  are  therefore  appropriate  candidates  for  an  approach 
using  systems  engineering  methodology  and  MCDT  within  this  methodology. 
The  first  three  issue  formulation  steps  of  problem  definition,  value  system 
design,  and  system  synthesis  are  accomplished  as  described  in  §  3.  Then  a 
combined  MOOT/MAUT  approach  is  used  to  perform  the  impact  analysis  and 
the  interpretation  of  impact  steps  as  described  in  §  4.  The  solution  obtained 
from  this  approach  to  EWARD  was  validated  on  an  EW  aircraft  using  appro¬ 
priate  data  and  advisors  who  acted  as  respondents  and  experts  in  various 
elicitation  tasks  associated  with  the  methodology. 


2.  The  electronic  warfare  aircraft  retrofit  decision  situation 

The  retrofitting  of  equipment  to  satisfy  a  particular  need  is  not  a  new 
concept  in  military  or  civilian  history.  The  size  and  complexity  of  current 
retrofits  efforts  in  the  EWARD  situation  in  the  U.S.A.  and  the  associated 
political,  economic,  military  and  technical  impacts  make  this  a  large-scale 
system  problem.  The  economic  concerns  are  felt  from  the  emphasis  of  the 
Congress  and  upper  echelon  military  policy  makers  who  must  consider  budge¬ 
tary  constraints  and  alternative  program  trade-offs.  The  size  of  the  problem  is 
significant  when  one  considers  that  a  fleet  of  fully  equipped  EW  aircraft  can 
cost  ten  times  the  price  of  the  original  aircraft.  The  political  factors  are  also 
considerable  when  the  governmental  policy  makers  consider  the  ramifications 
of  putting  certain  equipment  on  the  aircraft  which  impact  on  U.S.  security, 
NATO  agreements,  ‘  SALT  ’  talks,  foreign  weapons  sales,  etc.  The  techno¬ 
logical  concerns,  while  easier  to  quantify,  are  nevertheless  substantial  when  one 
considers  the  problem  of  fitting  sophisticated  electronic  equipment  into  an 
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airframe  designed  primarily  to  carry  ordnance.  The  problem  of  size,  weight, 
volume,  antennas,  power  type,  air  crew  requirements,  etc.  must  be  considered 
(Cook  1977,  Peterson  et  al.  1975,  USAF  1977  a).  Optimization  techniques 
which  consider  only  the  technical  aspects  of  the  retrofit  design  problem  have 
met  with  only  limited  success  (Peterson  et  al.  1975). 

To  give  an  appropriate  perspective,  from  which  the  difficulty  in  the  retrofit 
design  of  an  EVV  aircraft  is  apparent,  the  prescribed  retrofit  procedure  will  be 
presented  along  with  a  set  of  impediments  to  enactment  of  this  process.  There 
are  five  phases  of  an  EW  retrofit  system  program  as  viewed  by  government 
program  managers.  The  five  phases  of  Conceptual,  Validation,  Development, 
Production,  and  Deployment  contain  various  funding  decision  points.  The 
stakeholders  are  amalgamated  into  three  groups.  Group  G-l  (Operations  and 
Intelligence)  is  composed  of  the  system  users  ;  using  commands,  Strategic  Air 
Command  (SAC),  Tactical  Air  Command  (TAC),  etc.,  and  the  intelligence 
community.  Group  G-2  (Government  policy)  is  made  up  of  Headquarters 
U.S.  Air  Force  (Hq.  USAF),  Congress,  and  the  excutive  branch.  Group  G-3 
(Technical  development  and  assessment)  is  made  up  of  the  industrial  contractors, 
and  in-house  government  development,  contract  monitoring  and  user  inter¬ 
facing  subgroups  ;  Air  Force  Systems  Command  (AFSC),  and  Air  Force 
Logistics  Command  (AFLC).  Decision  makers  and  advisors  from  these  three 
Groups,  who  are  involved  in  EW  equipment  acquisition,  took  part  in  this 
effort  which  is  intended  only  to  evaluate  a  methodological  approach. 

2.1.  Specified  EW  retrofit  procedure 

The  USAF  is  guided  in  the  procurement  of  military  equipment  by  various 
regulations  and  directives  (e.g.  USDOD  1977  a,  USAF  1961*  b).  The  following 
discussion  describes  the  prescribed  way  that  an  EW  retrofit  is  accomplished 
in  the  U.S.  Air  Force.  The  process  starts  with  the  identification  by  the  using 
commands  in  group  G-l,  or  the  intelligence  community,  of  a  deficiency  or 
need.  This  deficiency  can  be  a  previously  recognized  weakness  which  now  can 
be  corrected  through  successful  efforts  of  government  laboratorier  or  industrial 
contractors  through  the  acquisition  of  a  new  system.  This  deficiency  or  need 
is  presented  by  the  using  command  to  Hq.  USAF  in  the  form  of  a  statement  of 
need  (SON),  and  this  is  where  group  G-2  becomes  involved  in  the  effort. 
If  the  initial  estimate  of  system  research,  development,  test,  and  evaluation 
(RDT  &  E)  exceeds  175  million  or  $300  million  in  production,  the  program  is 
designated  a  major  systems  acquisition.  As  a  major  systems  acquisition,  the 
Defense  Systems  Acquisition  Review  Council  (DSARC)  review  program  is 
required.  The  mission  element  need  statement  (MENS)  is  next  generated. 
This  must  identify  the  mission  need  in  terms  of  the  task  to  be  performed, 
assessment  of  projected  enemy  threat,  and  existing  DOD  capability  (USDOD 
1977  b).  Hq.  USAF  reviews  the  MENS  and  forwards  it  to  the  Secretary 
of  the  Air  Force  (SAF)  who  approves  it  and  sends  it  to  the  Secretary  of  Defense 
(SECDEF)  tor  final  approval,  or  redirects  it  for  appropriate  modification  or 
termination.  If  the  need  is  judged  as  legitimate  and  current  by  the  SECDEF 
the  program  is  initiated  (milestone  0)  by  authorization  of  funds  for  the 
Conceptual  Phase. 

In  the  Conceptual  Phase,  funding  is  made  available  to  a  System  Program 
Office  (SPO)  cadre  in  group  G-3  to  define  the  acquisition  problem,  identify 
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program  objectives  and  goals,  and  alternative  candidate  systems.  The  SPO 
also  develops  models  to  evaluate  operational  considerations,  acquisition 
approaches  and  associated  risk  factors.  Using  cost  and  performance  trade¬ 
offs,  candidate  systems  are  evaluated  to  identify  one  or  more  alternatives  for 
entry  into  the  Validation  Phase.  Next,  development  of  a  Program  Manage¬ 
ment  Plan  (PMP)  is  undertaken  as  the  summary  of  the  previous  efforts.  The 
PMP  is  used  as  the  basic  document  defining  pertinent  aspects  of  the  retrofit 
system.  The  PMP  is  used  to  prepare  the  Program  Management  Directive 
(PMD)  which  summarizes  the  previous  efforts  in  the  Conceptual  Phase,  and 
presents  a  plan  for  proceeding  into  the  Validation  Phase.  Hq.  USAF  uses 
the  PMD  to  generate  the  Decision  Coordinating  Paper  (DCP)  as  input  to  the 
Air  Force  Systems  Acquisition  Review  Council  (AFSARC).  AFSARC  makes 
recommendations  on  the  program  and  forwards  these  to  the  SAF.  If  the 
DCP  is  approved,  it  is  passed  to  the  DSARC  (milestone  I)  for  action.  Follow¬ 
ing  recommendations  by  DSARC,  the  SECDEF  is  tasked  with  final  decision  on 
the  program.  If  approval  is  granted,  funding  authorizes  proceedings  into  the 
Validation  Phase.  The  Conceptual  Phase  is  purely  a  ‘  paper  ’  effort  with 
no  funding  authorized  for  hardware. 

When  the  Validation  Phase  is  authorized  by  the  SECDEF,  a  SPO  (G-3) 
is  tasked  with  generating  the  basis  from  which  one  or  more  contractors  are 
selected  to  go  into  the  Development  Phase.  Validation  is  achieved  through 
either  a  contract  definition  (paper  design)  or  a  prototype  (hardware  demons¬ 
tration)  approach.  In  the  ‘  contract  definition  ’  approach,  usually  two  (or 
more)  contractors  are  allowed  to  compete  with  each  other  in  an  attempt  to 
further  define  and  refine  the  system.  A  Request  for  Proposal  (RFP)  is  issued 
which  initiates  the  paper  study.  The  results  of  this  phase  are  system  specifi¬ 
cations  and  a  statement  of  work.  A  source  selection  team,  including  repre¬ 
sentatives  from  G-I,  G-2  and  G-3,  selects  the  most  attractive  contractors  from 
the  competing  group.  A  RFP  is  issued  and  funding  negotiations  for  the 
Development  Phase  are  completed  with  the  selected  contractors.  In  the 
‘  prototype  ’  approach,  a  Development  Concept  Paper  (DCP)  from  the  Service 
Secretary  (G-2)  initiates  the  process.  A  formal  RFP  is  distributed  to  industry, 
and  a  Source  Selection  Team  usually  chooses  one  or  more  contractors  to  con¬ 
tinue  as  a  result  of  the  submitted  proposals.  The  selected  contractors  fabricate 
a  hardware  version  of  the  system  under  development.  This  hardware  system 
is  evaluated  analytically  in  a  demonstration  or  ‘  fly-off  ’  exercise.  During  this 
evaluation,  a  RFP  is  prepared  for  Full-Scale  Development,  and  the  most 
satisfactory  competitor  is  selected  for  further  development.  In  either  contract 
definition  or  prototype  approaches,  a  PMP  is  prepared  next,  followed  by  the 
DCP  and  PMD,  and  a  DSARC  board  meets  for  milestone  II  (G-l,  G-2,  G3)  to 
judge  the  worthiness  of  the  program  to  proceed.  If  the  program  is  judged 
essential  and  proceeding  satisfactorily,  the  SECDEF  acts  on  the  program. 
If  the  program  is  approved,  a  PMD  (G-2)  is  sent  to  the  SPO  and  funding  is 
approved  as  authorization  to  proceed  to  the  Full  Scale  Development  Phase. 
Other  alternative  actions  to  proceeding  into  Development  are  to  return  to 
more  validation,  or  cancellation. 

The  Full-Scale  Development  Phase  provides  the  expanded  engineering 
design,  fabrication,  testing,  evaluation,  and  support  planning  for  the  selected 
system.  The  ‘  user  '  and  ‘  supporting  commands  ’  participate  in  the 
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Development  Test  and  Evaluation  (DT  &  E)  and  Initial  Operational  Test  and 
Evaluation  (IOT  &  E).  The  contractor  negotiates  for  production  during  the 
testing  process,  and  configuration  audits  (FCA  and  PCA)  are  accomplished 
subsequent  to  finalizing  the  system  configuration.  After  this,  any  change  in 
the  system  is  rigidly  controlled  and  must  follow  the  formal  Engineering  Change 
Proposal  (ECP)  route.  The  results  of  the  Development  Phase  are  presented 
to  DSARC  at  milestone  III  for  review.  If  approval  is  granted  and  Office 
of  the  Secretary  of  Defense  (OSD)  funding  procured,  the  program  enters 
production. 

In  the  Production  Phase,  the  system  is  produced  by  the  contractors  and 
logistic  support  is  procured.  This  by  far  is  the  most  costly  and  time-consuming 
phase  up  to  this  point.  The  completed  system  is  turned  over  to  the  user  in 
the  Deployment  Phase  by  the  Systems  Manager  (SM)  in  Logistics  Command 
(AFLC).  There  the  system  is  utilized  and  maintained  until  its  retirement. 

2.2.  EW  program  complications 

The  process  just  described  for  EW  retrofit  of  an  aircraft  is  seldom  followed 
exactly  because  of  a  number  of  complex  factors  pertinent  to  electronic  warfare. 
There  are  seven  basic  reasons  for  EW  retrofit  difficulties. 

(1)  Electronic  tear  fare  is  a  highly  technological,  expensive,  and  specialized 
business.  EW  equipment  requires  extensive  dedicated  research  and  develop¬ 
ment  capabilities  that  only  a  limited  number  of  industrial  contractors  have 
established.  The  risks  in  developing  and  retrofitting  these  sophisticated  and 
specialized  systems  are  high,  and  the  spin-offs  to  commercial  application  are 
severely  limited. 

(2)  There  is  insufficient  communication  between  all  stakeholders  at  all  phases 
of  the  system  cycle.  There  is  a  lack  of  effective  interchange  of  information 
between  groups  G-l,  G-2  and  G-3  in  the  Conceptual  Phase  of  system  develop¬ 
ment.  An  exception  to  this  lack  of  communication  occasionally  exists  beween 
the  upper  level  DMs  in  groups  G-l  and  G-2  when  politically  sensitive  equipment 
is  involved.  The  general  lack  of  communication  makes  any  kind  of  long  range 
planning  for  the  system  retrofit  very  difficult.  This  lack  of  communication 
prevents  the  cost  and  performance  people  from  coming  to  early  agreement 
which  generally  means  time  delays  at  later  phases  in  the  system  cycle. 

(3)  The  decision  making  structure  is  multilevel  and  sentidefined .  The  decision 
makers  (DMs)  and  their  advisors  in  G-l  and  G-3  groups  are  defined  but  arranged 
in  multilevels  which  makes  it  difficult  for  amalgamation  of  objectives  at  these 
various  levels.  The  DMs  and  their  advisors  in  G-2  group  are  also  arranged  in 
multilevels  but  are  not  clearly  defined.  This  means  that  certain  gerents  can 
participate  in  varying  degrees  in  their  decision  making  role  depending  on 
factors  such  as  the  political  atmosphere.  This  fragmentation  makes  it  parti¬ 
cularly  difficult  to  account  for  some  DMs  interactions. 

(4)  Government  policy  makers  do  not  operate  in  sufficient  isolation  front 
private  industry.  The  government  policy  advisors  in  G-l  and  G-2  groups 
perpetuate  a  long-standing  amendable  relationship  between  themselves  and 
EW'  industries.  While  this  relationship  can  be  beneficial  to  the  government 
in  certain  aspects  of  rontraet  negotiations,  it  can  cause  difficulties  such  as  tin- 
fact  that  system  deficiencies  (and  their  amelioration)  are  often  pointed  out  by 
the  system  builder  or  contractor  instead  of  the  intelligence  community. 
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(5)  Long  range  government  policy  is  difficult  to  forecast.  The  complex  issues 
that  affect  foreign  policy  coupled  with  a  bureaucracy  that  administers  it, 
makes  it  particularly  difficult  to  estimate  accurately  what  the  U.S.  foreign 
policy  will  be  for  other  than  very  short  planning  horizons. 

(6)  The  current  funding  directives  ( USOMB  Circular  109)  encourage  ( and 
occasionally  specify)  dual-contractor  development  procedure  for  newly  designed 
equipment.  This  is  done  as  a  way  of  ensuring  commonality  in  technology,  and 
preventing  a  sole  source  supplier  of  replacement  parts.  Unfortunately  this 
practice  of  carrying  two  contractors  throughout  the  program  also  tends  to 
cause  funding  and  scheduling  problems. 

(7)  The  contractor  and  retrofit  program  are  often  given  flexibility  with  respect 
to  cost  and  schedule  commitments.  The  primary  reason  a  program  gets  limited 
in  scope,  indefinitely  delayed,  or  cancelled  is  that  it  has  been  surpassed  on  the 
priority  list  (and  another  program  took  its  funds).  The  logical  reasons  for  the 
above  actions  (lack  of  performance  in  the  system,  cost  and  schedule  overruns) 
are  not  considered  as  prominently. 

These  factors  presented  above  make  the  normal  EW  retrofit  procedure  of 
§  2.1  difficult  to  implement.  These  items  point  out  the  need  for  a  compre¬ 
hensive  approach  to  the  EWARD  such  as  supplied  by  MOOT  or  MAUT 
approaches  from  systems  engineering.  These  multiple  criteria  approaches 
allow  the  incorporation  of  a  set  of  salient  attributes  in  a  w  ay  that  allows  one  to 
address  the  requirements  by  individually  considering  factors  which  are  affected 
by  the  impediments  discussed  previously.  This  flexibility  is  of  significant  value 
in  a  large-scale  effort  like  EWARD.  In  EWARD,  the  need  exists  for  an 
adequate  set  of  criteria  which  can  be  utilized  in  the  evaluation  of  alternatives. 
The  development  and  subsequent  incorporation  of  these  criteria  into  the 
difficulties  cited  produce  a  cost-effective  product  that  will  meet  the  needs  of 
the  users. 


3.  Structure  of  the  EWARD  decision  situation 

In  order  to  set  the  stage  for  the  application  of  techniques  from  both  MOOT 
and  MAUT,  an  issue  formulation  effort  covering  the  problem  definition,  value 
system  design,  and' system  synthesis  steps  was  performed  in  order  to  identify 
and  relate  the  factors  of  the  U.S.  Air  Force  EWARD  structure.  Sections 
1  and  2  have  just  described  pertinent  stakeholders.  The  G-l  group  (Operations 
and  Intelligence)  is  reponsible  to  point  out  deficiencies  and  coordinate  require¬ 
ments  so  the  retrofitted  system  is  operationally  satisfactory.  This  group 
includes  the  eventual  Users  of  a  retrofitted  system.  The  G-2  group  (Government 
policy)  is  the  group  that  coordinates  the  systems  impact  on  defence  capability 
and  foreign  policy.  This  group  also  constrains  the  program  with  respect  to 
budgetary  considerations.  The  G-3  group  (Technical  development  and 
assessment)  defines  the  system  configuration,  and  carries  out  anil  manages  the 
research,  development  and  production  of  the  retrofit  system.  While  other 
stakeholders  are  involved  in  EWARD,  their  interactions  are  extremely  difficult 
if  not  impossible  to  define,  assess  or  forecast. 

The  general  needs  of  an  EWARD  are  defined  in  the  SOX  and  MENS 
documents  which  delineate  currently  existing  deficiencies.  Historically, 
specific  needs  of  the  new  system  are  described  as  threats  to  be  countered  in 
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terms  of  requirements  and  EW  techniques.  The  aircraft  which  will  be  retro¬ 
fitted  is  often  an  obvious  choice  because  of  the  performance  requirements, 
operational  situation,  and  current  aircraft  inventory  supply.  The  number  of 
these  special  purpose  aircraft  required  for  the  specific  mission  is  often  specified 
and  considered  fixed  in  the  early  phases  of  the  DOD  equipment  acquisition 
cycle.  Therefore,  the  aircraft  upon  which  the  retrofit  will  be  applied  as  well 
as  the  fleet  size  is  hypothesized  as  determined,  and  its  selection  is  not  to  be 
considered  in  this  pre-analysis  phase. 


Figure  I.  Hierarchy  of  objectives  of  the  EW  selection  process. 


The  possible  options  to  ameliorate  current  deficiencies  are  listed  in  the 
Conceptual  and  Validation  Phases  in  terms  of  passive  procedures,  trans¬ 
mitting  and  receiving  system  techniques,  and  active  and  passive  expendables 
disbursement.  The  major  constraints  for  the  retrofit  system  are  size,  weight, 
power,  and  cooling  restrictions  (determined  by  the  aircraft  itself),  funds  avail¬ 
able  (a  function  of  the  deficiency  priority  and  other  factors),  and  time  until 
deployment  (a  function  of  bureaucratic  scheduling,  and  research  and  develop¬ 
ment — R  &  D  status). 

The  main  objectives  of  the  EW  task  which  were  constructed  as  a  result  of 
interaction  with  the  stakeholders  arc  shown  in  Fig.  1.  It  is  this  latter  set  of 
objectives  that  were  utilized  in  our  solution  of  the  EWAUl).  The  measures, 
criteria,  or  attributes  by  which  attainment  of  the  objectives  is  discerned  are 
shown  in  Fig.  2.  This  set  of  attributes  was  used  in  the  evaluation  process  for 
the  alternatives  in  this  EW'ARl)  effort. 

While  lowest  level  criteria  or  attribute  measures  may  seem  self-explanatory, 
a  brief  description  is  provided  to  cover  some  of  the  aspects  of  the  EWAUl). 
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**  Direct  Assessment 
*  Direct  Performance  Measure 


Figure  2.  Attribute  template  for  EWARD. 


(a)  The  aircraft  weight  attribute  is  a  measure  of  the  added  weight  (kg) 
due  to  the  total  EW  system  plus  a  penalty  figure  (also  in  kg)  which  accounts 
for  any  modifications  to  the  fuselage  caused  by  the  EW  system  which  would 
increase  drag  such  as  external  antennas,  external  components,  external  wing 
pods,  air  induction  cowlings  for  cooling,  etc.  The  drag  caused  to  the  aircraft 
fuselage  by  a  system  is  converted  to  equivalent  penalty  weight  as  a  way  of 
accurately  quantifying  the  impact  of  a  specific  system  on  the  aircraft  perfor¬ 
mance  without  double  counting  with  respect  to  another  attribute. 

(b)  The  volume  attribute  (m3)  is  a  measure  of  internal  volume  occupied 
by  the  EW  system.  The  available  volume  for  EW  equipment  is  usually 
limited  because  of  competition  from  other  needed  avionics  equipment. 

(c)  The  power  attribute  (kvars)  is  a  measure  of  the  peak  electrical  power 
required  to  operate  the  EW  equipment  (including  auxiliary  cooling). 

(d)  The  air  crew  performance  attribute  (direct  performance  measure) 
measures  the  degree  of  dedicated  service  that  the  EW  system  demands  out 
of  the  crew  for  successful  operation  (some  manual/automatic  systems  may 
require  more  crew  .operations  than  is  physically  possible).  Values  of  this 
attribute  can  be  obtained  by  simulation  of  the  cybernetic  candidate  system. 
A  normalized  scale  (limits  of  0-0  to  1-0)  was  used  to  score  the  various  alter¬ 
native  systems.  The  minimum  score  of  0-0  represents  the  case  where  the  air 
crew  was  unable  to  perform  the  tasks  required  by  an  alternative  system  in  a 
simulated  combat  environment.  The  maximum  score  of  1-0  represents  the 
case  where  the  air  crew  was  able  to  perform  all  tasks  required  for  completely 
successful  operation  of  the  alternative  system  in  a  simulated  combat  environ¬ 
ment. 

(e)  The  threats  affected  attribute  (number  of  threats  degraded)  is  a  measure 
of  the  ability  of  the  EW  system  to  affect  individual  threat  tvpes  in  a  dense 
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environment  (currently  operational  and  forecast  threats  validated  by  a  threat 
group). 

(/)  The  threats  defeated  attribute  (number  of  threats  defeated)  measures 
the  number  of  specific  threat  types  defeated  which  are  made  inoperable  by  the 
EW  system. 

(g)  The  cost  attribute  (dollars)  is  a  measure  of  the  life  cycle  costs  of  the 
EW  system  to  include  R  &  D,  production,  and  maintenance  of  the  expected 
life  of  the  system.  This  total  life  cycle  cost  approach  is  applied  with  increasing 
frequency  to  DOD  equipment  acquisition  programs. 

(h)  The  policy  satisfaction  attribute  (direct  effectiveness  measure  o i 
directives,  policies,  and  requirements  satisfied)  is  a  measure  of  the  degree  to 
which  the  EW  retrofitted  aircraft  satisfies  forecast  government  policies,  parti¬ 
cularly  of  the  G-2  group,  for  the  production  decision  point.  Policy  satisfaction 
includes  concepts  influencing  candidate  EW  system  political  attractiveness  at  a 
point  in  time  in  the  future  (the  production  decision  point).  This  then  requires 
one  to  forecast  the  political  mood  and  subsequent  government  policy.  Some 
of  the  elements  which  are  included  in  this  factor  are :  attitude  toward  U.S. 
defence  posture  by  the  administration  and  congress,  need  for  foreign  arms  sales, 
treaty  and  alliance  commitments,  budgetary  priorities  and  amounts  of  federal 
spending,  military  lobby,  time  to  production  of  EW  system,  availability  of 
manufacturers  to  meet  the  requirement  for  dual  source  suppliers  of  critical 
parts  of  a  system,  employment  and  unemployment  effects  on  certain  con¬ 
tractors,  granting  of  subcontracts  of  a  system  for  the  sake  of  keeping  a  base  of 
companies  involved  in  defence  oriented  work,  etc.  None  of  the  DMs  inter¬ 
viewed  were  able  to  quantify  all  of  the  above  elements,  so  an  attempt  at 
aggregation  of  the  elements  met  with  some  success.  The  DMs  were  able  to 
express  the  fact  that  as  the  time  until  production  increased,  the  probability  of 
accurately  forecasting  the  political  policies  which  would  need  to  be  satisfied 
decreased  exponentially. 

All  DMs  agreed  after  discussing  that  this  factor  needs  inclusion  even  if  it  is 
very  difficult  to  quantify  accurately.  This  concensus  among  DMs  and  advisors 
for  including  policy  satisfaction  as  one  of  the  objectives  justifies  the  use  of  a 
MCDT  approach  such  as  MOOT  or  MAUT.  A  normalized  scale  (limits  0  0  to 
1-0)  was  used  to  score  the  alternatives  with  respect  to  policy  satisfaction.  The 
minimum  score  of  0-0  represents  the  case  where  it  is  estimated  that  an  alter¬ 
native  will  not  satisfy  any  of  the  policies  in  effect  at  the  production  decision 
point.  The  maximum  score  of  1-0  represents  the  case  where  it  is  estimated  that 
an  alternative  will  satisfy  all  policies  in  effect  at  the  production  decision  point. 
The  DMs  and  advisors  estimated  policy  satisfaction  scores  for  the  candidate 
systems.  A  maximum  time  for  initiation  of  production  was  established  at 
eight  years  so  that  the  values  could  be  obtained  for  various  candidate  systems 
with  certain  characteristics. 

It  is  noted  that  no  comprehensive  set  of  attributes  (as  complete  as  the  set 
just  presented)  is  now  used  in  the  initial  design  stages  of  the  current  EWAHD 
efforts.  The  DMs  and  advisors  interviewed  in  this  effort  agreed  that  the  above 
set  of  attributes  covers  the  salient  considerations  of  an  EW  retrofit  program, 
and  that  the  goodness  of  a  specific  system  could  be  adequately  evaluated  using 
these  attributes. 
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The  alternative  policies  that  achieve  the  objectives  with  respect  to  an  EW 
task  are  the  selection  and  retrofit  of  EW  equipment  into  the  designated  aircraft. 
A  specific  action  is  the  selection  and  retrofit  of  a  specific  EW  system  with  the 
designated  number  and  type  of  the  primary  components  (including  associated 
airborne  and  ground  equipment)  as  indicators  of  this  activity  (e.g.  system  a  has 
16  transmitters,  3  receivers,  1  processor  and  4  expendables).  Each  separate 
system  designated  has  characteristics  measurable  by  the  lower  level  attributes 
mentioned  earlier  (e.g.  systems  *  could  have  weight  /?,  life  cycle  cost  T,  degrade 
Q  threats,  etc.).  The  attribute  values  and  characteristics  of  each  specific 
system  in  competitition  for  selection  can  have  deterministic  and  probabilistic 
values  (e.g.  R  &  D  may  not  yet  be  completed  and  the  weight,  cost,  and  number 
of  threats  covered  are  not  known  with  certainty,  but  utilizing  data  and 
estimates,  distributions  covering  the  stochastic  elements  were  obtained). 

A  hypothetical  deficiency  designation  and  set  of  possible  EW  systems  to 
ameliorate  this  vulnerability  will  now  be  described.  A  hypothetical  situation 
is  selected  because  the  security  classification  pertaining  to  past  and  ongoing 
EW  systems  would  prevent  the  publication  of  these  results  in  unclassified 
texts  thereby  prohibiting  a  general  usefulness  which  is  the  purpose  of  this 
research.  While  no  information  is  compromised,  the  hypothetical  situation 
characteristics  are  relevant  to  actual  EW  systems  so  that  DMs  and  advisors 
could  realistically  take  part  in  the  EWARD  effort  (in  the  opinion  of  the  DMs 
and  advisors  interviewed,  the  hypothetical  situation  mimicked  reality  to  a 
high  degree).  The  hypothetical  situation  was  also  used  to  produce  a  general 
solution  procedure  that  may  be  situation  specific,  but  not  equipment  specific 
(i.e.,  the  modelling  done  was  intended  to  be  general  in  nature — applicable  to 

_ Lower  Level  Attribute  Limits _ 


Attribute  Greatest  Level  Lowest  Level 


X.  Aerodynamic 
performance 


Xla  EW  system  weight 

Xlb  EW  system  volume 

A. 5  x  103  kg 

A.  10  m3 

5.0  x  102  kg 
1.5  m3 

Xlc  EW  system  power 

105.0  KVA 

45.0  KVA 

Xp  EW  system  life  -  , 

c  cycle  cost 

2.0  x  109  ($) 

1.0  x  10®  ($) 

X3  Electronic  warfare 
performance 

X3a  Aircrew  effectiveness 

1.0  (normalized 
scale) 

0.0 

X~.  Number  of  threat 

D  types  degraded 

30.0 

5.0 

X3c  Nun,ber  °f  threat 
types  defeated 

30.0 

0.0 

X^  Degree  of  policy  1.0  (normalized  0.0 

satisfaction  scale) 


Table  1.  Lower  level  attribute  limits. 
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Alternative  Retrofit  Systea 
Configurations  and  Characteristics 


Alternative 

Descriptive  Phase 

1  (aj) 

Coaproaiae  1  (average) 

2  U2) 

High  cost,  high  reliability 

3  (•,) 

High  electronic  warfare  performance 

*  tv 

High  aircraft  performance 

5  <»5) 

Low  electronic  wsrfare  performance 

6  <S> 

Low  aircreft  performance 

7  (•,) 

Low  cost 

»  UB> 

Coaproaiae  2  (average) 

Table  2.  Alternative  retrofit  system  configuration  and  characteristics. 


any  EW  system  of  the  present  and  near  future — and  not  intended  to  concentrate 
only  on  modelling  specific  pieces  of  equipment  for  a  single  solution). 

Assume  the  deficiency  statements  (MENS  and  SON)  designated  S'  primary 
threats  and  N"  secondary  threats  (specific  active — radar,  laser,  etc.,  and  passive 
— infra-red,  electro-optical,  etc.)  which  are  sources  of  intelligence  for  enemy 
fire  control  systems  and  armaments  (airborne  interceptor,  anti-aircraft  artillery, 
surface-to-air  missiles,  etc.).  A  set  of  EW  system  components  both  developed 
a:id  proposed  to  counter  these  S  threats  (N  =  S'  +  AT")  is  available  from 
governmental  and  industrial  sources.  For  our  hypothetical  situation,  the 
attribute  limits  for  the  possible  system  components  are  shown  in  Table  1. 

A  set  of  alternative  proposed  systems  was  assembled  which  are  representative 
and  typical  of  the  spectrum  of  choices  which  confront  the  analysts  and  policy 
makers  in  the  Conceptual  Phase  of  EWARD.  This  list  of  alternative  E\V 
system  configurations  shown  in  Table  2  is  hypothetically  generated  as  a 
response  of  the  RFP  :n  the  initial  stage  of  the  Conceptual  Phase.  These 
alternatives  are  described  by  a  dominant  characteristic.  These  alternative 
configurations,  with  expected  attribute  levels  and  associated  normal  probability 
density  functions,  were  constructed  from  USAF  supplied  in-house  and  contractor 
empirical  data,  and  supplemented  by  expert  opinion  when  incomplete  data  was 
available.  For  example,  the  opinions  of  DMs  and  advisors  from  G-l,  G-2 
and  G-3  were  used  to  estimate  levels  of  attainment  for  the  alternatives  and 
accompanying  probability  density  functions,  since  little  or  no  data  was  avail¬ 
able  for  this  task.  Means  and  standard  deviation  for  their  attribute  levels  are 
described  by  Table  3.  Normal  density  functions  are  utilized  later  in  the  impact 
assessment  and  decision  making  steps. 

In  order  to  establish  a  basis  upon  which  to  choose  an  appropriate  MCDT 
approach,  the  attributes  were  investigated  with  respect  to  preferential  indepen¬ 
dence.  Selected  DMs  and  advisors  from  each  group  were  interviewed  to 
examine  how  these  gerents  trade-off  levels  of  the  attributes.  Using  standard 
assessment  techniques,  second  order  preference  independence  was  explored 
(Keeney  anti  Raiffa  1970,  Keefer  197S,  Keeney  1974).  The  major  attributes 
(X„  A\,,  X3,  S4)  were  found  to  be  preferentially  independent  (FI)  and  the 
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Alternative  Configurations 
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*D  ■  Degraded  Configuration 
*1  ■  Improved  Configuration 


Attribute  and  Accompanying  Standard  Deviations 


Table  3.  Alternative  configurations. 


(  X^  and  X,  were  consistently  traded  off  according  to  the 
curves  above  for  various  joint  levels  of  X2  and  X^). 

Figure  3.  Preference  independence  of  attributes. 


components  of  X,  and  X3  were  also  found  to  be  PI.  An  example  of  the  PI 
assessment  for  Group  3  is  shown  in  Fig.  3.  The  set  (A',,  A',)  is  preferentially 
independent  of  Xi}  (set  levels  of  all  other  attributes  except  A',  and  Xj)  if 
preferences  for  consequences  differing  only  in  the  value  of  Xt  and  A'^  do  not 
depend  on  the  fixed  value  of  X,j. 
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The  appropriate  point  in  the  defence  system  equipment  program  phases  for 
the  effort  reported  here  to  occur  is  between  Conceptual  Phase  authorization 
and  Program  Management  Plan  preparation.  Our  results  should  be  used  to 
aid  in  judging  the  contractor  competition  or  sole  source  performance,  and  also 
used  as  inputs  to  the  final  RFP  after  contractor  selection  before  production. 
The  information  needed  to  perform  the  portion  of  the  evaluation  effort  on 
EWARD  as  here  is  identified  in  the  Conceptual  Phase. 


4.  A  multicriterion  evaluation  process 

Factors  in  EWARD  such  as  the  lack  of  an  adequate  scalar  performance 
measure,  the  high  level  of  complexity,  and  the  difficulties  cited  which  hamper 
an  efficient  acquisition  process,  make  this  situation  a  likely  candidate  for  a 
comprehensive  multiple  criteria  approach  like  the  combined  MOOT/.MAUT 
multicriterion  process  utilized  here. 

The  EWARD  situation  contains  certain  characteristics  such  as  a  set  of 
attributes  which  the  DMs  and  advisors  have  established  as  preferentially 
independent  and  an  indication  by  the  DMs  and  advisors  that  they  would  prefer 
to  reduce  the  number  of  alternatives  before  comparing  and  ranking  the  re¬ 
maining  alternatives.  The  DMs  and  advisors  traditionally  attempt  toeliminate 
some  alternatives  before  examining  the  remaining  in  more  depth,  and  were 
comfortable  working  in  this  mode.  These  characteristics  in  EWARD  suggest 
that  a  combined  MOOT/MAUT  process  is  appropriate  for  modelling  and 
resolving  this  decision  situation.  The  MOOT/MAUT  process  as  applied  to 
EWARD  will  follow  the  basic  algorithm  outlined  in  DeWispelare  and  Sage 
(1980).  The  main  steps  are  (a)  conduct  a  pre-analysis  or  issue  formulation 
step,  (b)  eliminate  the  inferior  alternatives  through  an  elimination  by  asjiects 
exercises  (Tversky  1972)  and  multiple  objective  optimization  theory  (MOOT) 
toeliminate  dominated  solutions  and  form  a  non-dominated  solution  set  (NI)SS), 
(c)  elicit  the  preference  structure  of  the  DMs  to  subsequently  develop  a  scalar 
choice  function  which  ranks  the  remaining  alternatives  to  identify  the  optimal 
policy  using  multi-attribute  utility  theory  (MAUT),  (<l)  conduct  a  sensitivity 
analysis  and  validation  exercise,  (e)  prepare  an  action  plan. 

In  response  to  the  development  of  a  MENS,  retrofit  system  configurations 
from  the  contractors  become  available  which  represent  the  alternative  actions. 
All  of  the  proposed  alternative  systems  are  feasible  alternatives,  and  no 
preliminary  scanning  is  required  in  EWARD  at  this  point  in  the  effort  to 
eliminate  the  unacceptable  alternatives.  Because  a  large  amount  of  engineer¬ 
ing  design  is  required  for  interfacing  a  complete  retrofit  system,  information  is 
available  at  this  point  (Conceptual  Phase)  which  basically  establishes  the 
impacts  of  each  alternative  action  (implementing  an  alternative  retrofit  system). 
Therefore,  no  tuning  or  refining  of  the  alternative  systems  is  required  in  the 
Conceptual  Phase  unless  none  of  the  alternative  actions  are  viable  solutions  to 
the  deficiencies  cited  in  the  MENS.  The  criteria  established  in  the  pie- 
analysis  phase  was  used  as  the  basis  for  developing  the  attributes,  shown  in 
Fig.  2,  used  in  this  effort. 

The  identification  of  alternatives  which  arc  superior  with  respect  to  the 
attributes  developed  in  the  issue  formulation  stop  is  undertaken  through  forma¬ 
tion  of  the  NDSS.  In  order  to  utilize  the  data  concerning  the  attributes,  which 
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include  risk  information,  stochastic  dominance  was  used  to  indicate  which  of 
the  alternatives  was  dominated.  The  eight  alternatives  were  compared  to 
each  other  with  respect  to  the  stochastic  dominance  of  attribute  values  to  see 
if  any  alternatives  were  dominated  with  respect  to  all  attributes.  The  cumu¬ 
lative  probability  distribution  (CDF)  for  attribute  values  for  each  of  the  alter¬ 
natives  with  respect  to  system  weight  (xla)  is  shown  in  Fig.  4.  When  the  area 


Figure  4.  Distribution  of  system  weight  for  nine  EWARD  alternatives. 


under  the  CDF  for  an  alternative  (A,)  is  less  than  the  area  under  the  CDF 
of  another  alternative  (Aj)  (for  a  specified  attribute),  A,  is  said  to  dominate 
Aj  in  the  sense  of  stochastic  dominance  for  that  attribute.  Af  is  said  to 
dominate  Aj  if  stochastic  dominance  is  present  for  all  attributes  for  A,  with 
respect  to  A}.  Stochastic  dominance  relationships  were  established  for  all 
alternatives  on  a  pairwise  basis  for  all  attributes  with  the  results  that  only  one 
alternative  system,  alternative  no.  6,  is  dominated.  The  large  XDSS  was 
expected  since  there  are  a  number  of  conflicting  objectives.  In  the  interest 
of  reducing  the  number  of  alternatives  in  the  XDSS  further,  to  bring  the 
XDSS  membership  to  a  number  of  acceptable  by  the  DMs,  an  elimination  by 
aspects  exercise  was  conducted.  Each  group  was  asked  to  come  up  with  a  set 
of  realistic,  from  their  specific  vantage  point,  minimum  acceptable  attainment 
levels  that  the  alternatives  would  have  to  pass  to  be  considered  in  the  non- 
dominated  solution  set.  These  levels  are  shown  for  all  three  groups  in  Table  4. 
In  this  elimination  by  aspects  exercise,  the  analyst  must  ensure  that  all  attain¬ 
ment  levels  of  the  attributes  which  are  exceeded  by  an  alternative  reflect  an 
essential  shortcoming  in  the  EWARD.  This  elimination  by  aspects  eliminated 
three  alternatives  (alternatives  2,  3  and  5)  each  of  whose  attribute  values 
violated  many  minimum  attainment  levels  of  the  stakeholder  groups.  There 
were  then  four  alternatives  comprising  the  XDSS,  alternatives  1,  4,  7  and  8. 

In  order  to  select  the  best  alternative  system  from  the  reduced  XDSS, 
and  to  facilitate  using  risk  concepts  in  the  decision  process,  a  M  AUT  technique 
was  utilized  for  the  ranking  of  alternative  systems decision  making  phase. 
The  characteristics  of  the  situation  such  as  an  available  set  of  attributes,  the 
availability  of  the  directly  assessed  preference  structure  of  the  DMs  and 
advisors,  and  the  availability  of  probabilistic  information  concerning  the 
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Required  Attainment  Levels 


Attributes 

Group  1 

Group  2 

Group  3 

Xia(*S> 

<  3000.00 

<  4500.00 

<  3500.00 

Xlb(m5) 

5  3.20 

<  4.  10 

« 3.60 

Xlc(KVA) 

5  90.00 

<  105.00 

<:  90.00 

X2  ($xl09) 

<  1.50 

<  1.40 

<  1.70 

X  * 

X3a 

>  0.50 

>0.00 

>  0.45 

Xjb( threats) 

»  16.00 

>  10.00 

>  9.00 

X^c( threats) 

>  10.00 

>  2.00 

>  5.00 

X4  * 

»  0.33 

>  0.50 

»  0.40 

*  Normalized  Scale 

5  Maximum  Attainment  Level 
>  Minimum  Attainment  Level 

Table  4.  Required  attainment  levels. 


attribute  values  for  the  alternatives,  suggest  the  use  of  multi-attribute  utility 
theory  (MAUT). 

Multi-attribute  utility  theory  (MAUT)  has  been  a  very  popular  technique 
for  use  in  decision  situations  with  multiple  attributes.  This  requires  the 
identification  of  subjective  or  objective  probability  for  uncertain  consequences, 
and  elicitation  of  DMs  preferences  or  utility  over  these  attributes  (Keeney  and 
Raiffa  1976,  Keeney  and  Wood  1977,  Brown  el  al.  1974,  Barclay  et  al.  1977, 
Huber  and  Johnson  1977,  Sage  1977,  Keeney  and  Kirkwood  1975).  The  added 


Initial  ranking  of  Alternatives  (decisions)  is  accomplished  by  averaging  out  the 
single  stage  decision  treei  l.e.  Max  E(u(i,a))  =  Max  (ip.(a.)u(z-(a.))) 

a  at  j  J  1  lJ  1 


Figure  5.  Multi-attribute  decision  analysis  model. 
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complication  of  multiple  DMs  and  advisors  at  various  levels  suggests  the  con¬ 
sideration  of  <;roup  amalgamation  of  preferences  (Banker  and  Gupta  1978, 
Keeney  and  Kirkwood  1973,  Xakayama  et  al.  1979). 

The  basic  decision  model  is  illustrated  in  Fig.  5.  The  decision  space  is  made 
up  of  individual  actions  of  the  reduced  XDSS 

ai  =  incorporating  set  i  (alternative  i)  of  equipment  .as  the  retrofit  system, 

i=  1,  2,  ...,  n 

Thus,  set  i  includes  a  combination  of  E\V  equipment  with  associated  attribute 
values  for  A',-,  »=1,2,  3,  4  as  discussed  in  Sj  3.  For  example,  selecting  a,, 
implementing  alternative  1,  causes  the  retrofit  of  a  system  with  components 
which  collectively  give  the  attribute  levels  ijjfi.e.  *,:i1,  r,-'11,  x3:|1,  jy'“)  with 
probability  pt  where  pl  is  the  combined  probability  of  x,  =  x,;",  x2  =  .»y“, 
x3  =  x3s»,  ,r4  =  .iy».  The  probability  of  the  system  configuration  under  alter¬ 
native  1  being  at  other  collective  attribute  levels  or  output  states  is  p(  where 

l/t 

»'=  1,  2,  ....  m  and  £  pt  =  1.  These  probabilities  express  the  likelihood  of  the 

i  =  1 

retrofit  system  giving  the  estimated  values  of  the  attributes  in  actual  operation 
on  the  aircraft.  In  order  to  incorporate  the  risk  of  system  implementation 
into  the  MAUT  format,  output  configurations  other  than  the  expected  con¬ 
figuration  were  constructed  from  the  data  and  combined  with  probabilities  of 
realization  from  Monte  Carlo  simulations.  In  order  to  keep  the  problem  in 
a  framework  that  current  EWARD  stakeholders  are  familiar  with,  only  three 
resulting  configurations  were  used  for  each  alternative  configuration.  The 
characteristics  of  these  three  configurations  (a  degraded,  expected,  and 
improved  version)  of  each  alternative  system  is  shown  in  Table  4.  Because  of 
the  normal  density  function  forms  for  all  candidate  systems,  three  standard 
probabilities  were  used  for  the  three  approximate  outputs  of  each  candidate 
system  (/>  =  0  «3  for  the  expected  configuration  state,  p  =  01C  for  the  improved 
configuration  state,  and  p  =  0-lG  for  the  degraded  configuration  state).  Figure 
7  illustrates  the  rationale  behind  this  approximation.  This  discretization  of 
the  probabilistic  data  means  that  m  =  3  and  n  =  8  for  the  EWARD  formulation 
of  MAUT  posed  in  Fig.  5. 

This  MAUT  technique  was  utilized  for  specific  application  in  the  Conceptual 
Phase  of  EWARD  so  as  to  be  able  to  incorporate  available  information  from 
all  groups  at  an  early  phase,  and  to  specify  the  retrofit  configuration  and 
evaluate  the  resulting  system.  Care  was  taken  to  separate  the  subjective 
probability  encoding  and  utility  assessments  so  as  to  minimize  any  interaction 
confounding  effects  such  as  bias  and  double  weighting  of  certain  events  and 
outputs. 

The  first  items  addressed  were  the  functional  relationships  between  attri¬ 
butes  and  the  form  of  the  multi-attribute  utility  function  which  would  measure 
an  aggregated  felicity  for  each  alternative  retrofit  system.  Since  preferential 
independence  among  attributes  was  established  in  the  pre-analysis  phase,  first 
order  utility  independence  ( U I )  was  next  examined.  A”,-  is  UI  of  A,  (all 
attributes  other  than  A’,)  if  preferences  for  risky  choices  (lotteries)  over  A, 
with  the  value  of  A',  held  fixed  do  not  depend  on  the  fixed  value  of  A,.  Using 
standard  MAUT  assessment  techniques  (Keeney  and  Raiffa  1970),  it  was 
found  that  X,  was  utility  independent  ;  and  because  (X,,  A,)  is  PI,  /  =  2,  3.  4, 
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using  Theorem  6.2  of  Keeney  and  Raiffa  (1976)  it  can  be  concluded  that  the 
major  attributes  are  mutually  UI  (MUI).  The  components  of  each  of  Xt 
and  X3  were  also  found  to  be  MUI.  Next,  the  attributes  were  examined  with 
respect  to  Fishburn  Marginality  ( rishburn  1967,  Winterfeldt  and  Fischer  1973). 
It  was  soon  pointed  out  by  the  interviewees  or  respondents  that  additive 
independence  did  not  hold.  Therefore  invoking  the  fact  that  the  attributes  are 
MUI  and  Theorem  6.1  of  Keeney  and  Raiffa  (1976),  we  conclude  that  a  multi¬ 
plicative  form  of  multiattribute  utility  function  is  appropriate  for  this  appli¬ 
cation.  The  multiplicative  utility  function  has  the  general  form 

1  +  A«  =  n(l  +  A'A>()  (!) 

i 

where  u  is  the  combined  utility  function,  ui  is  the  tth  constituent  utility 
function,  A',-  is  a  scaling  constant  for  the  tth  utility  function,  and  K  is  the 
scaling  constant  for  the  combined  utility  function.  Specifically,  the  utility 
functions  for  attribute  X,  and  X3  respectively  are 

1  -) -k1ltl  =  (1  -t-l‘il‘iattla(-rla))(l  +^l^‘lcWtc(a‘lc))  (~) 

and 

1  +  k3u3  =  ( 1  +  k3k3aii3a(x3a))(  1  +  k3k3bu3b(x3b))(  1  4-  &3fc3ct(3c(.t'3c))  (3) 

where  umn  is  the  lower  level  attribute  utility  function,  Uj  is  the  higher  level 
utility  function,  and  the  k's  are  scaling  constants.  The  aggregate  utility 
function  for  each  group  is 

1  +  AT  t  =  (1  +  A’A1«1)(  1  +  KK3u2)(  1  +AA’jW3)(  1  +  A A4m4)  (4) 

where  Ut  is  the  combined  utility  function  for  each  group,  i  =  1,  2,  3  and  the 
A"'s  are  scaling  constants.  The  multiplicative  form  adds  complexity  of  analysis 
compared  to  the  additive  form,  but  also  supplies  the  required  non-compensatory 
inter-attribute  relations  necessary  in  this  problem  (DeWispelare  and  Sage  1979). 

The  utility  independence  condition,  which  was  verified  for  all  attributes, 
allows  the  assessment  of  eight  single  dimension  utility  functions.  The  utility 
function  for  each  attribute  was  needed  to  incorporate  the  DMs  and  advisor’ 
preferences  and  attitude  toward  risk.  Because  of  the  many  gerents  at  various 
levels  in  EWARD,  a  refinement  form  of  social  choice  function  was  used  to  bring 
the  individual  utilities  of  the  DMs  and  advisors  together.  Using  a  modified 
form  of  the  multiple  independent  entity/MCDM  process  of  Banker  and  Gupta 
(1978)  intended  for  decentralized  DMs,  the  utility  functions  were  extracted  for 
each  attribute  from  the  lower  level  advisors  and  DMs  in  each  group  (G-l,  G-2 
and  G-3).  These  utility  functions  were  then  presented  to  intermediate  and 
eventually  high  level  DMs  in  each  group  for  refinement.  These  refined  utility 
functions  were  then  shown  to  each  ievei  of  DM  until  concensus  was  reached  on 
the  final  form  for  each  group  (G-l,  G-2  and  G-3).  This  way  of  incorporating 
the  group  utility  into  a  single  function  seemed  to  work  well  in  this  application 
because  it  followed  the  basic  organizational  ‘  chain  of  command  '  hierarchial 
decision  making  process  of  the  government  (lower  level  advisors  counsel  higher 
level  DMs  and  higher  level  DMs  feedback  policy  which  focuses  this  advice 
thereby  causing  rapid  convergence  to  a  single  social  choice  or  welfare  function). 
The  refined  group  utility  functions  for  the  attributes  are  given  in  Table  •>. 
An  example  of  the  group  utility  curves  for  attribute  .v3fc,  number  of  threats 


1230 


A.  R.  DeWispelare  and  A.  P.  Sage 


degraded,  is  shown  in  Fig.  6.  The  majority  of  the  utility  curves  exhibit  a 
preference  structure  which  is  risk  averse  as  illustrated  in  Fig.  6.  The  risk  averse 
tendencies  by  the  DMs  and  advisors  were  expected  in  a  project  which  involves 
government  officials  (Levy  1974). 


Group  1  Group  2  Group  3 


Aircrew  Effectiveness 
(Normalized  Scale) 


Figure  6.  Group  utility  functions  for  attribute  x3ll. 


Group  Utility  Functions  For  Each  Attribute 


Group  1 

!  Group  2 

1  Group  3 

ula<xla} 

U  52-0.44axp<3. lE-4x.  )  1 

*la*3500 

-0.97+2.4exp{-2. 0E-4xla)l 
*lai3500 

1.13-2.5E-4  xla 

1.0S-0.06  exp(  6.5E-4xla; 

“lb^lb’ 

1.26-0.10  exp(0.6lxlb) 

1.65-0.39exp(0.35xlb) 

1.41-0. 19exp(0.49xlb) 

ulo<xlc) 

1 • 37-0. 15exp( 0.02  *lc) 

1.28-0.09  exp(0.02  xlc) 

1.19-0.05  exp(0.03xlc) 

u2(*2) 

1.13  -0.11  • 
exp( 1.15  E-9  «2I 

1.0 1-0. 01exp(2.1  E-9J^) 

1.18-0. 16exp(1.0  E-9  x2 

u3«(x3a> 

0.99(x3a)l 

-1.01+1.0exp(0.7(x3a)1,1) 

-2.97-0.35exp(-5.1x1a) 
♦3.32exp(0.l8x3a)  Ja 

“jb^jb* 

4.92-5.13exp(-0.  01  x3b) 

2.53-2. 8oexp(-0.02X3b) 

1.18-1.7»*p(-0.08x3b) 

u3c(x3c> 

1.52-1.53exp  (-0.04  x3o) 

1.5  9-1.  59exp(-0.02  x,  )i 
x3oS20  3c 

-0.52t0.60exp(0.03(x-.)i 

x3c*  20  3 

1.01-1.01exp(-0.13x3<;) 

U4 (*4) 

I.OX4 

1.01  -l.ol  exp(-5.1*4) 

-L0+1.01exp(0.69x4) 

Table  5.  Group  utility  functions  for  each  attribute. 


Since  we  have  established  the  multiplicative  form  of  combined  multi¬ 
attribute  utility  function,  the  task  of  evaluating  the  scaling  constants  for  this 
form  were  approached  next.  Using  suggested  assessment  techniques  (Keeney 
and  Raiffa  1970)  with  the  interviewees,  the  group  utility  functions,  Table  5, 
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and  the  attribute  ranges,  Table  1,  the  scaling  constants  were  evaluated  for  each 
group  and  the  results  are  shown  in  Table  6  for  the  multiplicative  utility 
functions.  Each  group’s  relative  strengths  of  the  preferences  for  the  attributes 
is  evident  in  this  table.  For  instance,  the  values  of  the  combined  utility 
function  scaling  coefficients  show  that  Group  2  prefers  a  high  level  policy 
satisfaction  (Kx)  and  low  cost  (K2)  over  performance  (Kx  and  K3)  while  Group 
3  values  aerodynamic  (/v  x)  and  electronic  warfare  performance  (K3)  over 
political  (A'4)  and  financial  (K2)  considerations. 


Group  Utility  Pmctiona 
Ttap  Level  Utility  Functions 


l>KUi  -  (1*KK1u1)(1‘HCK2u2)(1^KK3u3)(1+KK4u4) 

where  *  combined  group  utility  function,  i  ■  1,2,3 

u*  *  higher  level  attribute  constituent  utility  function 
J  \  =  1.2. 


Scaling 

Coefficients 

Group  1 

Group  2 

.  CrouD  3 

K 

fH 

— 

-0.98 

Ki 

1-  ■ 

SMEEMp 

0.69 

k2 

iXkI 

0.46 

k3 

0.92 

*4 

mam 

0.45 

Lcwest  Level  Attribute  Utility  Functions 


l*kl“l  *  <1*ltlklaula(,tla))(1*klklt,ulb(xlb^<1+l'l'‘lculc()tlc)) 
u2  *  u2^x2^ 

1+k3u3  *  ( 1* Xja) ) ( 1* X3X3bu3b( *-)b) ) ( 1* k3k3c( x3c] * 

%  “  u4(x4) 


“mn 


lower  level  attribute  utility  function* 
m  *  1,3  n  «  a,b,c 


Scaling 

Coefficients 

Group  1 

wmm 

Croup  3 

ki 

-0.60 

-0.29 

0.14 

£la 

0.48 

0.40 

0.38 

klb 

0.59 

0.37 

0.26 

klc 

0.24 

0.35 

0.31 

*3 

ga 

wmwm 

5.04 

-0.97 

0.12 

0.42 

k3b 

0.25 

0.48 

k3c 

Wmm 

0.13 

0.95 

Table  6.  Group  utility  functions. 


Each  group's  (G-I,  G-2,  G-3)  utility  for  the  set  of  alternatives  described  in 
Tables  2  and  3  were  calculated  using  the  multiplicative  form  and  scaling 
constants  listed  in  Table  (i  for  the  attribute  template  of  Fig.  2.  The  constituent 
utilities  for  the  expected  values  of  the  candidate  systems  for  all  three  groups 
are  listed  in  Table  7.  The  combined  group  felicity  for  each  alternative  E\Y 
retrofit  system  (exacted  version,  improved  version,  and  degraded  version) 
in  the  reduced  XDSS  is  shown  in  Table  8.  The  ranking  of  alternatives  step 


>32  A.  R.  DeWispelare  and  A.  P.  Sage 

Utility  Values  For  The  Expected  Alternative  Configurations 

Alternatives  u*ai  "laj^a,  “l\  “Id.,  “I^  UA*  UA*  “a^  \  fz2  % 

1  .47  .43  .72  .8?  .81  .85  .58  .61  .64  .75  .65  .70  .68  .82  .65 

4  .95  .93  .98  .98  .97  .99  .91  .93  .94  .98  .97  .86  .81  .91  .78 

.58  .49  .54  .83  .85  .87  .80  .76  .77  .97  .98  .96 

.84  .87  .60  .63  .66  .80  .65  .70  .62  .78 


utility  of  component  j  (j  =  a,b,c)  of  attribute  X,  (  i  =  1,3)  for  Group 

k  (k  =  1,2,3) 

combined  utility  of  attribute  X  (m  s  A,C,A  for  X,  and  C  for  XOfor 
Group  n(n*  1,2,3)  ** 

utility  of  attribute  X  (a  *  2,4)  for  Group  5  (t  s  1,2,3) 


le  7.  Utility  values  for  the  expected  alternative  configurations. 


Utility  Por  The  Various  Configurations  Of  Alternatives 


Alternatives 


0.78  0.96  0.96 
0.83  0-97  0.93 
0.78  0.97  0.90 
0.82  0.95  0.97 


.76  0.94  0.94 

.82  0.95  0.89 

0.77  0.90  0.89 

0.80  0.93  0.94 


0.80  0.98  0.97 

0.86  0.98  0.9** 

0.81  0.94  0.90 

0.84  0.97  0.98 


u . -  *  utility  for  configuration  j  =  EiExpected,  I( Improved),  D(Degraded))  of 
Group  i  ( i  *  1,2.3) 

Table  8.  Combined  utility  for  the  various  configurations  of  alternatives. 


was  next  accomplished  by  maximizing  the  expected  individual  group  utilities 
using  the  decision  tree  of  Fig.  6.  The  resulting  group  utilities  for  each  alter¬ 
native  were  generated  by  averaging  out  the  single  stage  MALT  formulation 
of  Fig.  6  for  each  alternative  using  the  relation 


E[u(z,  «,.)]  =  V 


where  Pj(n,)  is  the  probability  of  outcome  and  1  the  multi-attribute 

utility  of  outcome  :Sj,  and  E\it{z,  a,)|  represents  the  expected  utility  or  score 
for  alternative  The  utility  data  of  Table  8  and  the  probability  data  dis¬ 
cussed  earlier  and  illustrated  in  Fig.  7  were  substituted  into  this  expected  utility 
formulation.  Table  1)  shows  the  output  of  these  calculations  and  the  resulting 
preference  rankings  for  the  individual  groups  with  respect  to  the  alternatives. 
The  closeness  of  the  utility  scores  for  each  group  is  explained  by  the  fact  that 
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even  though  utilities  were  elicited  for  the  full  range  of  each  attribute,  the 
alternatives  in  the  XDSS  had  attribute  values  that  were  in  a  much  narrower 
range. 


Group  Preference  Rankings  of  Alternatives 


Alternatives 

ui 

Ranking 

U2_ 

Ranking 

ul 

Ranking 

1 

0.781 

4 

0.965 

2 

0.958 

2 

4 

0.833 

1 

0.968 

1 

0.923 

3 

7 

0.784 

3 

0.959 

3 

0.906 

4 

8 

0.821 

2 

0.951 

— — _ 

4 

0.965 

1 

u  *  total  utility  for  given  alternative  of  Group  k  (k-l,2,3) 


Table  9.  Group  preference  rankings  of  alternatives. 


These  rankings  show  that  the  G-l  (operations,  intelligence)  prefer  the 
alternatives  which  aid  aircraft  performance  and  are  average  or  compromise 
systems.  This  was  expected  since  many  of  the  participants  in  G-l  have  air 
crew  experience  (pilots,  navigators,  weapons  operators,  etc.).  G-2  preferred 
the  compromise  and  low  cost  alternatives.  This  also  was  expected  since 
budgetary  constraints  and  political  agreements  are  driving  forces  for  the 
government  policy  makers.  It  is  noted  that  there  is  a  correlation  in  the  upper 
levels  of  alternative  choices  of  G-l  and  G-2  which  is  possibly  precipitated  by  the 
close  interaction  between  the  DMs  and  advisors  in  G-l  and  G-2  discussed  in 
§  2.  G-3  (program  managers,  contractors,  analysts,  etc.)  preferred  the  high 
E\V  and  aircraft  performance,  high  cost,  and  compromise  alternatives.  These 
choices  were  anticipated  since  engineers,  contractors,  and  analysts  in  G-3  are 
basically  performance  oriented  and  consider  cost  secondarily.  Alternatives  4 
(high  aircraft  performance)  and  8  (best  compromise)  were  highly  preferred  by 
all  groups.  Because  no  single  alternative  was  ranked  as  most  preferred  by  all 
groups,  the  final  modelling  step  was  the  combination  of  the  three  separate 
group  (G-l,  G-2  and  G-3)  multi-attribute  utility  functions  into  a  single  social 
choice  function  so  that  final  ranking  can  be  performed  for  the  EW’ARD  pre¬ 
sented.  Because  it  can  be  seen  from  Table  9  that  there  are  conflicting  ranking 
for  alternatives,  a  means  was  required  to  obtain  combined  group  consensus. 
Because  there  are  three  groups  and  more  than  three  alternatives,  there  is  no 
guaranteed  way  of  obtaining  consensus  (through  popular  techniques  like  simple 
majority  rule,  simple  additive  weighting,  etc.)  without  violating  Arrow's 
axioms  in  the  impossibility  theorem  (Arrow  1903).  This  is  because  inter¬ 
personal  comparison  of  utilities  is  required.  Nevertheless,  concensus  is 
required,  and  two  techniques  which  can  aggregate  the  group  utilities  arc  the 
cardinal  social  welfare  function  discussed  by  Keeney  and  Kirkwood  (1975) 
and  the  Extended  Contributive  Rule  method  (ECR)  discussed  by  Xakayama 
et  al.  (1979). 

The  Extended  Contributive  Rule  method  (BCR)  was  used  to  aggregate 
individual  groups'  preferences  into  a  single  choice  function  (Xakayama  it  til. 
1979).  ECR  amalgamates  the  preferences  of  the  DMs  in  a  way  that  incorporates 
directly  the  degree  of  confidence  of  all  the  individual  groups  in  their  own 
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preferences  and  in  other  groups’  preferences,  and  the  intensity  of  each  pre¬ 
ference.  ECR  was  particularly  applicable  to  EWARD  since  it  considers 
preferences  between  two  alternatives  at  a  time  and  therefore  given  an  output 
which  is  readily  transformed  into  a  directed  graph  indicating  preference 
relationships  (Sage  1977,  White  and  Sage  1980)  for  display  purposes.  The 
ECR  method  of  combining  group  preferences  was  chosen  over  the  simple 
linear  additive  and  multiplicative  forms  of  combining  group  utility  in  this 
application  because  of  two  reasons  : 

(1)  ECR  specifies  a  way  of  making  interpersonal  comparison  of  utility. 
Each  group  ranks  the  importance  of  the  opinion  of  all  groups  so  that 
weights  can  be  established  for  each  group’s  utility.  This  concept  of 
intergroup  weighing  makes  intuitive  sense  in  a  governmental  setting 
where  the  various  groups  realize  their  relative  position  with  respect  to 
the  political  structure  which  must  eventually  authorize  funding  for  the 
EWARD  production. 

(2)  ECR  allows  a  preference  threshold  to  be  incorporated  into  the  ranking 
of  alternatives  step.  This  thresholding  feature  affords  the  DM  the 
opportunity  to  not  only  establish  specific  preference  relations  between 
alternatives,  but  also  reveal  the  strengths  of  these  preference  relations. 
These  pairwise  preference  relations  can  then  be  easily  displayed  on  a 
digraph. 

The  ECR  algorithm  is  now  described.  >r  a  set  of  alternatives 
A-(AV  ...,  An),  and  group  utility  functions  ut  -  («„  u2,  u3),  let  wyz  be  the 
weight  which  group  y  imposes  on  the  utility  of  group  z.  That  is,  wyz  represents 
group  2  influences.  We  define  the  quantity 

_  3  /  3 

A  =  £  wi  •  ^uik  +  a  (  H  w 

» =  1  \  »-i 

where 

wi  =  (  Wvi )/3>  a>°-  0^°  and  &ujk=ui(Aj)-ui(Ak) 

For  two  alternatives  Aj,  AkeA  ;  A}  is  preferred  to  Ak  (A^aAj.),  at  an  opinion 
level  a  if  and  only  if  A  >  0.  All  possible  combinations  of  alternatives  taken  two 
at  a  time  are  categorized  with  respect  to  a  preference  existing  or  not  (binary 
relation).  The  parameter  a  indicates  the  weighing  which  is  given  to  opposite 
preference  opinions.  It  is  a  way  of  requiring  a  level  of  coincidence  (all  or  a 
majority  of  opinions  agree  in  order  to  establish  a  preference  relationship)  of 
individual  group  opinions  (i.e.  if  a  =  0,  no  consideration  for  opposite  opinions  is 
given  (no  agreement  of  opinion  is  required)  and  the  ECR  takes  the  form  of  a 
linear  additive  SWF  ;  if  a  is  large,  then  complete  unanimity  of  opinion  is 
required  to  establish  preference  relations  as  an  opposing  preference  is  heavily 
weighed).  The  parameter  /?  is  used  to  indicate  the  intensity  (strong,  weak, 
etc.)  of  the  preference  relations.  This  parameter  allows  the  DM  to  differentiate 
the  strong  from  the  weak  preference  relations.  It  is  in  effect  a  threshold  which 
can  be  set  to  allow  only  preference  relations  above  this  value  to  be  recognized. 
The  parameters  a  and  /3  are  initially  set  at  large  values  and  the  pairwise 
preference  relations  arc  determined.  These  preference  relations  are  trans¬ 
formed  into  a  digraph  indicating  preferences.  If  the  digraph  arrangement  of 


min  (0,  A ujk- 


■V 
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alternatives  does  not  have  vertical  structure,  then  the  threshold  /3  is  decreased 
in  small  steps.  This  has  the  effect  of  establishing  the  weaker  pairwise  pre¬ 
ference  relations  which  were  previously  cancelled  due  to  the  large  threshold. 
Ultimately  a  vertical  digraph  is  established.  If  /3  =  0  and  a  vertical  digraph  is 
still  not  evident,  then  the  coincidence  of  opinion  parameter,  a,  is  decreased  and 
the  algorithm  repeated  until  a  vertical  or  near  vertical  digraph  results. 

The  weights  shown  in  Table  10  were  elicited  from  each  group  to  establish 
the  intergroup  comparison  of  utilities.  The  ECR  algorithm  was  evaluated 
using  information  from  Tables  9  and  10  along  with  various  values  of  a  and  /S 
to  establish  the  preferences  shown  in  Fig.  7. 


Intergroup  Weighing  Of  Utilities 


-  is  the  weight  assigned  to  the  utility  of  Group  j  by  Group  i 

-  Wj  is  the  resulting  average  weight  of  Group  i 


Table  10.  Intergroup  weighting  of  utilities. 
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Figure  7.  Group  ranking  of  alternatives  using  ECR. 
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Figure  7  shows  that  there  are  three  alternatives  which  rank  consistently 
higher  than  the  other  alternatives.  These  alternatives  (1,  4  and  8)  exhibit 
medium  or  compromise  values  of  attributes  of  cost  and  EW  performance  along 
with  high  aircraft  performance.  For  «  (the  parameter  which  weighs  opposite 
preference  opinions  heavily)  in  the  range  of  0^  a  ^0-095  and  j3  =  0  (with  a  =  0, 
the  ECR  social  choice  function  assumes  the  form  of  a  linear  additive  SWF) 
alternative  8  dominates  (Fig.  9  (a)).  As  a  is  increased  to  larger  values,  the 
alternatives  aligned  themselves  in  two  groups  of  a  preferred  set  (I,  4  and  8) 
and  a  dominated  set  (7)  as  illustrated  in  Fig.  7  (b)  and  7  (c).  As  a  threshold 
value  was  brought  in  (/?  increases  from  0),  the  ranking  of  Figure  7  (a)  started 
to  decompose  until  the  strengths  of  all  preference  relations  are  overcome  and 
complete  unaniminitv  would  be  required  to  establish  a  preference  relation 
(Fig.  7  ( d )).  When  these  results  were  presented  to  the  advisors  and  DMs  in 
all  groups,  there  was  concensus  that  alternative  8  was  the  most  desirable  and  its 
specifications  would  be  used  as  the  standard  in  the  RFP. 

A  sensitivity  analysis  was  conducted  to  examine  the  robustness  of  the  final 
ranking  of  alternative  systems,  and  to  point  out  critical  areas  in  this  approach 
to  EWARD. 

As  a  check  of  the  DMs  consistency  in  the  MOOT/MAUT  process,  the  utility 
based  ranking  of  alternatives  was  made  just  prior  to  aggregating  the  group 
utilities  into  a  joint  SCF.  The  group  utility  was  calculated  for  all  alternatives 
not  in  the  NDSS.  The  combined  group  utilities  for  these  alternatives  were 
calculated  and  compared  to  those  in  the  NDSS.  The  resulting  rankings  showed 
that  alternatives  2,  3,  5  and  6  are  indeed  dominated  in  all  groups.  This 
indicates  that  the  DMs  were  consistent  in  the  value  scoring  of  alternatives, 
elimination  by  aspects,  and  utility  elicitation  tasks. 

The  significance  of  the  accuracy  of  the  input  data  on  the  ranking  of  the 
alternatives  was  tested  by  varying  the  average  values  of  Table  3.  Varying  the 
values  of  all  the  attributes  scores  by  5%  for  each  alternative,  first  in  a  beneficial 
and  then  detrimental  direction,  did  not  affect  the  groups  preference  ordering 
of  the  top  three  alternatives.  Varying  all  attribute  scores  by  5%  in  a  beneficial 
direction  for  the  second  best  alternative,  caused  this  alternative  (no.  4)  to 
become  optimal.  Changing  the  life  cycle  cost  attribute  weight  by  6%  caused 
a  decision  switch  from  alternative  8  to  alternative  4.  These  results  should 
alert  analyst  and  decision  maker  to  the  realization  that  alternative  system 
parameter  accuracy  is  important  in  that  alternative  4  is  almost  as  good  as 
alternative  8.  This  is  particularly  significant  also  when  considering  that  the 
data  for  the  policy  satisfaction  attribute  was  obtained  primarily  from  subjective 
estimates. 

Sensitivity  to  variation  in  the  individual  group  functions  weighting  co¬ 
efficients  was  greater  than  that  due  to  variation  of  alternative  scores  but  5% 
changes  in  weights  did  not  produce  any  consequential  change  in  rankings. 

A  check  on  the  effects  of  the  variation  of  the  individual  group's  stated 
minimum  acceptable  attainment  level  was  accomplished  next  since  these 
attainment  levels  were  the  basis  for  an  elimination  by  aspect  exercise.  It  is 
noted  that  because  all  attainment  levels  of  each  individual  group  had  to  be 
justified  to  the  other  groups,  only  reasonable  and  fairly  conservative  . 
ment  levels  were  supplied  by  the  groups.  While  variation  by  20°„  in  several 
attainment  levels  (policy  satisfaction,  threats  degraded,  etc.)  caused  variation 
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in  the  membership  of  alternatives  in  the  NDSS,  these  affected  alternatives 
(5  and  7)  were  marginal  and  not  prominently  ranked  in  the  final  analysis. 

Lastly,  the  robustness  of  the  selection  of  the  optimum  alternative  system 
vas  examined  with  respect  to  the  vyeighing  of  each  other’s  opinion  by  the 
individual  groups.  In  the  ECR  group  utility  aggregation  algorithm,  the 
intergroup  opinion  weights  were  varied  up  to  10%  with  only  minor  variation 
in  the  final  alternative  rankings  (alternative  system  4  and  alternative  system  1 
changed  places  in  the  rankings).  Alternative  8  was  still  the  optimum  choice 
even  with  this  variation  in  the  intergroup  comparison  of  utilities. 


5.  Validation,  acceptability,  and  implementation  considerations 

The  DMs  and  advisors  who  took  part  in  this  exercise  expressed  satisfaction 
in  the  MOOT/MAUT  approach  to  EWARD.  Therefore,  this  technique  was 
used  in  a  validation  exercise  to  see  how  it  would  have  done  on  an  actual  system 
which  is  operational  now.  The  data  from  a  recent  EW  retrofit  system  was 
processed  to  fit  the  modelling  approach  of  the  combined  MOOT/MAUT  method 
presented  in  this  paper.  Four  alternative  systems  were  reduced  in  the  three 
groups  (G-l,  G-2,  G-3)  to  a  set  of  non-dominated  alternatives  from  which  the 
groups  selected  a  ‘  best  ’  alternative.  The  alternative  which  was  selected 
was  a  modification  of  the  system  which  was  actually  retrofit  on  the  aircraft. 
All  groups  agreed  that  the  system  selected  by  the  MOOT/MAUT  approach 
was  superior,  and  was  selected  in  a  more  efficient  manner  compared  to  the 
system  which  was  eventually  retrofit.  The  DMs  expressed  their  opinions  for 
the  discrepancy  and  these  can  be  summed  up  in  two  points  ; 

(1)  There  was  no  comprehensive  set  of  criteria,  such  as  in  Fig.  2,  which 
could  be  used  to  judge  system  goodness  early  in  the  acquisition  life 
cycle  in  the  actual  retrofit. 

(2)  There  was  a  lack  of  communication  between  pertinent  stakeholders  in 
the  actual  retrofit  which  was  significantly  ameliorated  by  the  suggested 
technique.  Therefore,  it  is  concluded  that  this  exercise  validates  the 
appropriateness  and  efficacy  of  the  use  of  MCDT  (specifically  the 
MOOT/MAUT  approach)  in  the  early  phases  of  the  DOD  Equipment 
Acquisition  Life  Cycle. 

Twenty-one  DMs  and  advisors  from  various  stakeholder  groups  took  part 
in  the  elicitation  part  of  this  effort.  Interviews  with  these  participants  con¬ 
sisted  of  fact  finding  and  preference  elicitation  sessions.  The  average  time 
spent  with  each  participant  was  2-4  hours,  and  the  maximum  time  for  any 
individual  was  18  hours.  The  majority  of  participants  (nineteen)  expressed 
satisfaction  and  acceptance  of  this  approach  to  EWARD,  and  indicated  they 
would  be  in  favour  of  using  this  technique  in  future  efforts.  The  majority  of 
participants  gave  the  opinion  that  the  two  main  benefits  of  this  approach  to 
EWARD  are  : 

(1)  The  final  product  is  an  acceptable,  cost  effective  system. 

(2)  There  is  a  definite  savings  in  time  accrued  through  this  approach  (the 
participants  estimated  that  up  to  one  years  time  (50%)  in  t  he  Conceptual 
Phase  could  be  saved  utilizing  t his  technique)  compared  to  the  present 
design  procedure. 


1238 


A.  R.  DeWispelare  and  A.  P.  Sage 


As  mentioned  in  §§  2  and  3,  the  application  of  the  MOOT/MAUT  approach 
to  EWARD  should  be  in  the  Conceptual  Phase  of  the  Defence  Systems 
Acquisition  Cycle  before  the  PMP  is  prepared.  The  application  at  this  point 
in  the  acquisition  cycle  would  allow  for  a  maximum  of  benefits  (determine  the 
system  configuration  and  get  all  pertinent  groups  communicating)  without  the 
need  for  legislation,  or  any  changes  of  the  current  regulations.  The  current 
regulations  do  not  generally  specify  application  of  particular  techniques,  but 
they  allow  for  the  application  of  desirable  techniques.  The  analysts  required 
could  be  drawn  from  the  staffs  in  all  three  groups  (User  Commands,  Hq. 
USAF  and/or  DOD,  and  Systems/Logistics  Commands),  and  formed  into  a 
dedicated  team  for  the  EWARD  (versus  working  at  the  retrofit  problem  in 
fragmented  groups  as  they  do  currently)  without  the  requirement  for  additional 
personnel.  This  team  would  ideally  be  responsible  to  the  DSZRC/SECDEF 
to  allow  the  team  to  operate  with  the  cooperation  of  all  groups  but  immune 
from  the  influence  of  any  one  group. 

6.  Summary 

In  this  effort,  a  decision  situation  involving  Electronic  Warfare  Aircraft 
Retrofit  Design  (EWARD)  was  modelled  and  resolved  using  the  combined 
MOOT/MAUT  approach.  We  began  our  efforts  with  an  overview  of  the  DOD 
Equipment  Acquisition  Cycle  as  set  down  in  various  regulations  and  directives. 
Several  considerations  in  the  electronic  warfare  community  were  described 
because  of  difficulties  they  cause  in  the  acquisition  procedure.  The  primary 
stakeholder  groups  were  identified  along  with  their  interaction  in  the  equipment 
retrofit  situation.  The  decision  making  procedure  was  applied  to  the  Con¬ 
ceptual  Phase  of  the  DOD  Equipment  Acquisition  Cycle  where  it  was  intended 
to  produce  two  results  : 

(1)  A  salient  set  of  design  criteria  (candidate  system  descriptors)  which 
can  be  used  in  judging  the  goodness  of  a  proposed  EW  alternative  design 
in  the  early  phases  of  the  EW  equipment  acquisition. 

(2)  A  decision  making  procedure  for  candidate  system  selection  as  a  basis 
for  system  selection  and  the  RFP. 

The  EWARD  situation  was  modelled  around  attributes  adequate  for  judging 
the  EW  retrofit  system  and  a  set  of  realistically  based  alternatives  for  a 
retrofit  design.  These  alternatives  were  supplied  with  attribute  levels  and  the 
associated  risk  for  realization  of  the  alternatives.  Using  the  MCDT  approach, 
the  combined  MOOT/MAUT  process  was  used  to  solve  the  EWARD  situation. 
A  pre-analysis  phase  was  used  to  structure  the  decision  situation.  The  optimi¬ 
zation  step  consisted  of  a  multi  dimensional  elimination  by  stochastic  domi¬ 
nance  exercise  since  the  impacts  of  implementing  the  various  alternative 
systems  are  provided  by  the  competing  contractors.  The  resulting  NDSS  was 
further  reduced  in  the  number  of  alternative  systems  when  the  individual  groups 
supplied  minimum  acceptable  attainment  figures  for  the  attributes  as  an  input 
to  an  elimination  by  aspects  exercise.  The  MAUT  technique  of  multi-attribute 
decision  analysis  was  used  to  model  and  rank  the  alternatives  in  the  NDSS  by 
developing  a  cardinal  utility  SCF  for  each  group.  These  group  utility  functions 
were  amalgamated  into  an  ultimate  SCF  which  produced  a  final  ranking  of  the 
NDSS  and  identification  of  alternative  8  as  the  optimum  system  configuration. 
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Group  consensus  corroborated  this  alternative  selection.  A  certain  amount  of 
iteration  was  required  in  all  steps  of  the  MOOT  MAUT  process  in  order  to 
converge  to  an  acceptable  policy  choice. 

A  subsequent  sensitivity  analysis  of  the  final  ranking  of  the  alternatives, 
with  alternative  8  as  the  identified  optimal  configuration,  produced  the  follow¬ 
ing  observations  :  the  DMs  were  consistent  with  respect  to  value  scoring  and 
utility  function  scoring  of  the  attribute  as  a  basis  for  forming  the  XDSS  and 
then  ranking  the  resulting  alternatives  ;  the  final  ranking  of  alternatives  was 
somewhat  sensitive  to  the  accuracy  of  the  alternatives  systems  impact  data, 
and  the  stated  minimum  acceptable  attainment  levels  of  the  individual  groups  ; 
the  final  ranking  was  sensitive  to  the  accuracy  of  the  weighting  constants  in 
the  individual  group  utility  functions. 

A  validation  exercise  was  then  carried  out  using  data  from  a  recent  E\V 
retrofit  system.  The  groups  selected  a  system  using  the  approach  which  all 
DMs  and  advisors  stated  was  the  superior  system  of  the  alternatives  available. 

We  have  illustrated  the  use  of  a  MC’DT  approach  in  the  early  phases  of  a 
particular  equipment  acquisition  effort.  The  approach  can  produce  a  solution, 
based  on  values  and  data  provided  by  users,  which  contains  risk  uncertainty 
elements.  The  validation  effort  demonstrated  that  such  an  approach  forces 
DMs  and  their  advisors  to  consider  the  salient  attributes  early  anil  to  communi¬ 
cate,  or  at  least  add  opinions  and  inputs  to  the  situation,  with  other  stake¬ 
holder  groups.  The  technique  aids  the  decision  maker  in  evaluating  the  most 
desirable  alternative.  The  MOOT/MAUT  approach  involves  the  DMs  .n  a 
fashion  that  should  give  the  DMs  confidence  in  the  results  obtained. 
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abstract:  This  paper  surveys  contemporary  research  involving  error  and  sensitivity 
analysis  approaches  useful  for  the  design  of  aids  for  planning  and  decision  support. 
Discussed  are  structural  sensitivity  considerations  as  well  as  the  effects  of  errors,  for 
both  single  and  multi-attribute  cases,  in  estimation  or  elicitation  of  probabilities  and 
utilities.  One  of  the  major  uses  for  sensitivity  analysis  type  results  is  in  bounded 
prioritization  of  alternatives  using  ordinal  information.  This  use  of  sensitivity  analysis 
is  discussed  and  illustrated  with  examples. 


I.  Introduction 

A  contemporary  effort  of  much  interest  is  the  design  of  evaluation  and 
choice  making  aids  for  planning  and  decision  support  processes.  These 
adjuvants  are  sometimes  called  management  information  systems,  although 
we  feel  that  the  terms  decision  support  system,  or  planning  and  decision 
support  system,  are  more  appropriate.  A  central  purpose  in  use  of  these 
systems  is  not  just  presentation  of  information  representing  facts  and  values, 
but  the  aggregation  of  this  information  to  aid  in  evaluation  and  choicemaking. 
Research  in  this  area  involves  many  disciplines  and  perspectives;  and  thus  we 
have  a  large  scale  systems  problem.  There  are  a  number  of  sources  of  error  in 
the  design  of  decision  analysis  algorithms  for  planning  and  decision  support 
systems.  We  discuss  several  of  these  in  this  paper,  namely;  errors  in  the 
structure  of  the  decision  situation,  errors  in  the  elicitation  of  probabilities,  and 
errors  in  the  assessment  of  single  and  multiple  attribute  utility  functions. 
Decisionmakers  sometimes  find  it  very  difficult  to  provide  precise  (cardinal) 
estimates  of  weights  and  find  it  much  less  stressful  to  provide  ordinal  values. 
As  shown  in  Section  IV,  sensitivity  results  can  often  then  be  used  to  infer 
priorities.  We  conclude  our  survey  and  presentation  with  a  discussion  of  some 
contemporary  research  needs  in  this  area. 

II.  Sensitivity  to  Probability  Estimation  Errors 

In  decision  analysis  problems  under  risk,  it  is  necessary  to  obtain  an 
objective  or  subjective  estimate  of  the  probability  that  various  outcome  states 

tThis  research  was  supported,  in  part,  by  the  Office  of  Naval  Research  under 
Contract  N00I4-80-C-0542.  Several  discussions  with  Chelsea  White.  Ill  were  especi¬ 
ally  helpful  and  are  hereby  acknowledged. 
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wiH  result  from  decision  alternatives.  Once  a  recommended  decision  has  been 
established,  it  is  often  useful  to  determine  the  magnitude  of  the  changes  in  the 
state  probabilities  required  for  the  recommended  decision  to  become  less 
desirable  than  another  decision  alternative.  This  magnitude,  coupled  with 
some  knowledge  of  the  quality  of  the  state  probability  estimates,  can  be  used 
to  determine  how  confident  we  are  in  the  optimality  of  the  recommended 
decision. 

We  consider  the  three  outcome  state  case  first;  then  we  generalize  these 
results  to  the  n  outcome  state  case.  For  convenience,  we  assume  that  the 
probability  associated  with  each  outcome  state  is  independent  of  the  action 
alternatives.  With  alternative  a'  we  associate  an  outcome  utility  vector 

(«<)T  =  [«|  «i«j]  (1) 

and  we  write  for  the  outcome  state  probability 

PT=[PiPiPil 

The  expected  utility  of  alternative  a‘  is  then 

EU(a‘)  =  pTu‘  -  t  ,u i  +Pi«i  +Pj«>.  0) 

Now  suppose  that  the  probabilities,  pf,  are  perturbed.  Since  we  must  maintain 

p,  +  p,  +  pj  =»  I ,  Pi  a  0  (4) 

we  must  have 

Apt  +  Ap,  +  Ap,  =*  0.  (5) 

By  substituting  (4)  into  (3),  we  see  that  the  equation  for  constant  expected 
utility  is  that  of  a  straight  line 

££/(</')  =  uj  +p,(ul  -  uj)  +  p:(ui  -ui)  (*) 

in  two  dimensions,  p,  and  p:.  The  difference  in  expected  utility  for  alternative 
t  and  j  is  some  amount  A"  given  by 

A"  =  EU(a‘)  -  EU(a')  =  p,(m|  -  «j)  +  p;(uj  -  ui)  +  p,(uj  -  «{)•  (?) 

As  long  as  A1'  >0  wc  know  that  alternative  a'  is  preferred  to  alternative  a1. 
The  relation  A"  =0  graphs  as  a  straight  line  in  the  p,.Pt  plane  if  we  make  use 
of  (4)  to  eliminate  p,.  Doing  this,  however,  distorts  the  planes  of  interest 
somewhat.  Fortunately,  the  three  dimensional  space  for  pt,  P;.  Ps  becomes  a 
plane  when  we  associate  the  constraint  of  (4)  with  this  space. 

Figure  (I)  indicates  a  typical  probability  triangle.  It  is  straightforward  to 
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Fig.  I.  Probability  triangle  and  planar  projection  with  decision  switch  points  from 

Table  I. 

show  that  graphs  of  A"  =  0  are  straight  lines  in  Fig.  I.  For  example,  the  graphs 
of  A1'  =  0  for  the  problem  of  Table  I  are  shown  in  Fig.  I. 


Table  I 

Illustrative  utilities  for  a  simple  example 
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Of  interest  in  this  figure  is  the  fact  that  alternative  I  dominates  alternative  2  in 
the  utility  of  each  outcome  state  is  greater  for  alternative  1  than  for  alter¬ 
native  2.  Further,  it  is  not  possible  for  alternative  4  to  be  the  best  alternative 
and  the  optimum  decision  regions  are  as  shown  in  Fig.  2. 

For  more  than  three  outcome  states,  the  graphical  approach  suggested  here 
is  infeasible.  Isaacs  (12)  and  Fishburn  et  al.  (7)  describe  a  general  approach 
that  is  applicable  to  the  n  dimensional  case.  This  approach  allows  deter¬ 
mination  of  that  “second  best"  alternative  which  could  become  the  best 
alternative  due  to  a  minimum  overall  variation  in  probability. 

There  are,  in  general,  a  variety  of  possible  ways  in  which  probability 
estimates  can  be  incomplete.  Among  these  are  the  following  (6, 12): 

(1)  The  decision  maker  provides  an  estimate  of  the  p,. 

(2)  The  decision  maker  provides  a  probability  density  function,  g(p,),  for 
the  ph 

(3)  There  exists  no  information  about  the  />,. 

(4)  There  exists  an  ordinal  measure,  or  ordering  of  the  p(.  For  convenience, 
and  without  loss  of  generality,  we  may  assume  that  p,  2  p2  2  •  •  •  2  p„. 

(5)  There  exists  bounded  internal  measures  such  that  each  p,  is  bounded, 
such  as  af<pl<ai  +  e,  with  a,  2: 0,  e,  2  0. 

(6)  There  exists  a  set  of  inequalities  relating  the  P„  such  as 

*♦  I  k 

i-i 

(7)  Some  of  the  p{  are  known  whereas  others  are  related  by  inequalities  of 
the  forms  given  in  (4),  (5)  or  (6). 


p,.i 


Fig.  2.  Optimum  decision  regions  as  a  function  of  probabilities. 
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There  exists  several  ways  in  which  the,  possibly  partial,  information 
concerning  probabilities  may  be  processed  to  assist  in  evaluation  of  the 
alternative  courses  of  action.  Among  these  are: 

(a)  The  estimate  of  the  p„  if  provided,  may  be  used  to  obtain  the  subjective 

fl 

expected  utility  of  each  alternative  a *  from  the  relation  2  p,uj.  A  sensitivity 

/-i 

analysis  similar  to  that  of  our  Section  3  may  be  used  to  determine  the 
possibility  of  a  decision  switch  due  to  probability  elicitation  errors. 

(b)  The  expected  probability  of  each  event  outcome  may  be  computed 
from  Pj  =  J-.PjgiPj)  dp/  and  the  p;  used  in  place  of  the  p,.  Estimates  of 
subjective  expected  utility  are  obtained  as  in  (a)  above. 

(c)  Various  dominance  relations  may  be  obtained  from  the  ordinal  bounds 
and  bounded  interval  measures  provided  by  the  decision  maker. 

(d)  Various  minimum  changes  for  a  decision  switch  may  be  obtained. 

(e)  Regions  in  which  various  alternatives  are  best  may  be  determined  and 
displayed  for  the  decision  maker. 

Often,  various  forms  of  stochastic  dominance  (27,28)  can  be  used  to 
eliminate  alternatives  from  consideration  even  when  there  exists  little  or  no 
information  concerning  event  outcome  probabilities.  For  case  3,  in  which 
there  exists  no  probability  information,  alternative  j  will  dominate  alternative 
i  if  u‘  a  u‘,  with  the  inequality  holding  for  at  least  one  component  of  the  utility 
vector.  In  component  form  this  becomes  k  =  1.2 . n.  For  exam¬ 

ple.  we  easily  see  that  alternative  1  dominates  alternative  2  for  the  alter¬ 
natives  and  utilities  illustrated  in  Table  I.  This  may  be  written  a1  >  a2. 

Further,  it  is  often  possible  to  identify  an  alternative  which  may  not  be 
dominated  but  which  is  inferior  to  or  dominated  by  a  mixed  strategy  consis¬ 
ting  of  a  mass  probability  Fr  =  [F',F: . P]  on  the  set  of  primary 

alternatives  aT  =  [a1,  a2, - a"].  If  the  decision  maker  adopts  mixed  strategy 

F,  then  alternative  a‘  is  elected  with  probability  F*.  For  the  example  posed  by 
the  data  Table  I  we  see  that  0.5u  •  +  0.5h]  2ii',/  =  1,  2,  3.  Thus  alternative  4  is 
dominated  by  the  mixed  strategy  FT  =  [0.5, 0,  0.5, 0, 0],  Consequently  we  may 
delete  alternative  4  from  further  consideration  for  the  particular  case  when 
mixed  strategies  can  be  considered  and  when  there  is  no  information  available 
concerning  the  probabilities  of  event  outcomes.  It  is  dominated  by  the  mixed 
strategy  of  choosing  alternative  1  with  probability  0.5  and  alternative  3  with 
probability  0.5. 

In  the  general  case,  with  no  assessment  of  probabilities,  alternative  a‘  is 
dominated  by  a  mixed  strategy  F.  assuming  the  probability  vector  p  is  the 
same  for  all  alternatives,  if 


2  F’«i  a  u[  for  k  =  1.2 _ ,  n.  (8) 

If  there  exists  an  ordinal  ranking  of  probabilities,  as  in  case  4.  then  we  can 
easily  show  that  option  alternative  a •  is  dominated  by  a  mixed  strategy  if 


9 
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there  exists  a  mixed  strategy  F  such  that 

P'(^|  iif)  a  ^  uj  for  ;  =  1,2 . m.  (9) 

Unfortunately  there  does  not  appear  to  be  any  method  that  is  general  and 

simple  to  use  to  determine  appropriate  mixed  strategies.  Often,  also,  the 
appropriateness  of  mixed  strategies  must  be  questioned  for  many  ap¬ 
plications. 

For  the  case  where  there  exists  bounded  interval  measures  in  the  form  of 
case  5,  then  the  primary  strategy  alternative  a‘  dominates  alternative  a '  if 

8  +  [^  (10) 

where  9  is  the  minimum  value  of  the  objective  function  for  the  linear 
programming  problem 

min^xk(ui-ui)  (II) 

subject  to  0  s  x*  £  ek  and 


There  appear  to  be  no  general  formulae  for  cases  6  and  7  in  which  there 
exists  sets  of  inequalities  governing  the  p,.  For  any  given  set  of  inequalities, 
we  may  write  equations  involving  expected  utilities  and  then  equate 
coefficients.  A  paper  by  Barron  (I)  provides  two  detailed  examples  of  com¬ 
putations  involving  these  inequalities.  Additional  details  concerning  sen¬ 
sitivity  of  decisions  to  probability  estimation  errors  may  be  found  in 
(6,7,23.28,29). 

///.  Sensitivity  to  Variations  in  Utility — Single  Attribute  Utility  Functions  for 
Decisions  Under  Uncertainty 

In  this  section,  we  examine  sensitivity  relations  to  changes  in  utility 
functions.  This  section  will  concern  the  single  attribute  case.  We  will  extend 
the  results  in  this  section  to  the  scalar  multi-attribute  case  in  the  next  section. 
The  vector  multi-attribute  case  is  considered  in  (28).  When  considering  utility 
function  changes,  it  is  convenient  but  not  at  all  necessary  to  consider  that  the 
same  output  value  or  utility  function  is  common  to  all  alternatives.  We. 
therefore,  represent  different  alternatives  by  different  probability  density  or 
mass  functions. 

For  the  continuous  state  case,  we  consider  a  utility  function  n(x)  and 
alternative  a'  defined  by  the  associated  probability  density  function  /'(. x).  For 

the  finite  state  case  we  consider  a  utility  function  it{x,),  i  =  1,2 . n  and 

alternatives  a‘  defined  by  an  associated  probability  mass  vector  function  p' 
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which  has  n  components,  (p‘)T  =  [p'Cx,),  p'(x2) . p'(xj]  =  [pi,  pi, . . pi]. 

There  are  a  variety  of  ways  in  which  utility  estimates  can  be  stated, 
possibly  incompletely.  Among  these  are  the  following: 

(1)  The  decision  maker  may  provide  a  complete  estimate  of  the  value 
function  v(x)  and  utility  function  u(x). 

(2)  The  utility  function  u(x)  or  value  function  may  be  completely  un¬ 
specified. 

(3)  Only  ordinal  preferences  are  specified. 

(4)  The  value  function  may  be  specified,  but  not  the  risk  aversion 
coefficient.  In  this  case,  the  utility  function  is  unspecified. 

If  the  value  and  utility  function  are  completely  specified,  the  expected 
utility  of  each  alternative  may  be  computed  and  a  sensitivity  analysis  similar 
to  that  of  Section  IV  conducted  to  determine  the  potential  of  a  likely  decision 
switch  due  to  utility  and  value  function  elicitation  errors.  If  the  value  function 
is  completely  unspecified,  then  the  decision  maker  is  inchoate  and  there  is 
virtually  nothing  that  can  be  done  to  aid  the  decision  maker  except  through 
procedures  that  will  enhance  the  value  coherence  of  the  decision  maker. 

Much  information  concerning  alternative  option  preferences  can  be  obtained 
from  just  an  ordinal  ranking  of  preference  for  outcome  states.  In  the  sequel 
we  will  assume  that  the  decision  maker  can  always  express  an  ordinal 
preference  for  the  value  of  event  outcomes  of  the  form  u(x,)  £  i>(x:)  <  ■  •  •  ^ 
v(xn). 

When  ordinal  preferences  among  event  outcomes  can  be  elicited,  and  when 
probabilistic  estimates  of  occurence  of  these  states  can  be  obtained,  then 
concepts  of  stochastic  dominance  can  be  used  to  determine  bounds  on 
alternative  preferences.  And  if  values  but  not  utilities  are  specified,  then  it 
will  often  be  possible  to  specify  risk  aversion  coefficients  which  bound 
alternative  preferences.  We  will  illustrate  each  of  these  claims  by  means  of  a 
simple  example.  Prior  to  doing  this,  however,  it  is  desirable  to  establish  some 
fundamental  concepts  concerning  stochastic  dominance  (29). 

We  say  that  alternative  a'  is  preferred  to  alternative  a'  whenever  the 
expected  utility  of  alternative  a‘  is  greater  than  that  for  alternative  a'.  In 
symbols,  we  have  if  a'  >  a' 


J  f,(x)u(x)dx  >  J  ft(x)u(x)  dx  (13) 

where  f,(x )  is  the  probability  density  function  for  the  event  outcome,  x, 
associated  with  alternative  a';  and  u(x)  is  the  utility  of  the  outcome  states. 
We  wish  to  provide  for  a  value  function  v(x)  and  will  restrict  this,  for 
convenience  to  the  interval  (0,  I],  The  value  function  is  not  necessarily  a 
monotone  function  of  the  outcome  states,  x.  The  utility  function,  however, 
should  be  isolone  in  v.  Thus  it  is  convenient  to  rewrite  (13)  as  a'>  a'  if 

I"  f,(v)u(v)dv  2s  j  f,(v)u(v)dv  (14) 
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where  we  realize  that  the  utility  function  is  written  as  a[u(x)]  but  where  we 
delete  the  x  symbol  for  convenience. 

Stochastic  dominance  concepts  are  based  upon  the  imposition  of  a  series  of 
increasing  constraints  upon  the  form  of  the  utility  function  u(o).  The  most 
trivial  assumption  is  that  utility  is  a  monotone  increasing  function  of  increas¬ 
ing  value.  Thus  we  require  dv(v)ldv  =  u'(v)  a  0.  We  now  integrate  (14)  by 
parts.  Since  we  have 

Jt  fi(v)u(v)dv  =  Pi(v)u(v)U-J'  PMu'(v)dv  =  1  -J  Pj(v)u'(v)dv 
we  obtain  for  (14) 

['[PM-PJvHuWdvzO.  (IS) 

Jo 

Without  specification  of  u(v )  but  with  specification  that  u’(v)2  0,  we  see  that 
the  inequality  of  (15)  will  be  satisfied  if  and  only  if 

P,(v)5P,(v),  Vv  £  [0. 1J.  (16) 

With  the  inequality  holding  for  at  least  one  i.  This  is  the  requirement  for  first 
order  stochastic  dominance.  When  the  inequality  of  (16)  holds  we  say  that  a' 
dominates  a*  by  first  order  stochastic  dominance  or  a ‘  >  ,a'. 

We  can  rewrite  the  e*pression  for  the  probability  mass  function 

P'(v^  =  f0  fMdo 

in  terms  of  discrete  state  probabilities  pM).  /  =  1, 2, ....  k  as 

PM)  =  PM)- 

If,  in  addition  to  requiring  monotonicity  of  the  utility  function,  we  also 
require  risk  aversion;  then  we  impose  the  further  requirement  that 
d1u(v)ldv2  =  u"(v)  £  0.  We  integrate  (15)  by  parts  to  obtain 

M'(l)r(I)-f  r(v)a"(t>)di;  <0 

Jo 

where 

T( u )  =  f‘  [ P,(a)  —  P,(a)l  da. 

ill 

To  satisfy  this  requirement  for  n'(l)s0  and  u"(r)s0,  we  must  require 
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r(i>)  sO  in  the  interval  0  to  1.  Our  requirement  for  what  is  called  second  order 
stochastic  dominance  becomes,  therefore, 

f’[Pi(a)-P<(a)]dasO,  VpG[0,1].  (17) 

Jo 

For  the  finite  state  case  we  replace  (17)  with 

JE  [P.OO  -  P/o, )](»,♦.  -  p,1  s  0,  Vfc  £  C,  n]  (18) 

with  the  inequality  holding  for  at  least  one  k. 

An  excellent  discussion  of  stochastic  dominance  concepts  is  presented  in 
the  chapter  by  Fishburn  and  Vickson  in  (29). 

In  the  general  case  we  can  write  the  requirement  for  &th  order  stochastic 
dominance  of  alternative  a‘  over  a\  a‘  >  2a',  as 


rt(p)<0,  VpG[0,  1] 


(19) 


where 


T*(P)=  frv.,(a)da 

Jo 

r1(p)  =  p,(u)-p/(p). 


Satisfaction  of  (19)  will  insure,  for  increasing  k,  various  increasing  require¬ 
ments  on  risk  aversion  of  the  form  h'(p)2 0,  h"(b)s0 . (-  1)‘, 

A  particularly  interesting  case  occurs  for  k  =  The  utility  curve  for  infinite 
risk  aversion  is  given  by  u(v)  =  0,  v  =  0  and  u(v)  =  I ,VvE  (0. 1].  Generally,  it 
will  be  relatively  easy  to  determine  requirements  for  infinite  order  stochastic 
dominance.t  Since  the  strength  of  the  dominance  relation  increases  with 
increasing  order,  we  can  use  this  concept  to  advantage,  especially  in  the 
multi-attribute  case.  Note  that  we  will  be  able  to  determine  first  order 
dominance,  and  infinite  order  dominance,  for  many  discrete  state  problems 
with  only  ordinal  event  outcome  preference  information.  Value  preference 
bounds  may  be  determined  from  ordinal  preference  information  from  higher 
order  stochastic  domination  concepts.  This  requires  the  solution  of  linear 
programs,  much  the  same  as  those  of  (10)  to  (12)  (27-29). 

Mean  variance  dominance,  or  expected  value  dominance,  is  a  concept  that 
has  often  been  used,  especially  in  capital  budgeting  efforts.  Alternative  a' 
dominates  alternative  a'  in  terms  of  expectation  or  mean  value  domination  if 


tWe  can  also  compute,  with  relative  ease,  the  expected  utility  for  the  modified 
infinite  risk  aversion  case  where  u(v)  =  0.  Vo  G  [0,  r,|  and  u(v)  =  I.  Vo  €(«,.  I). 
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it  has  a  greater  expected  value  such  that 

d,  =  j  vfj(v)dv  a  vfj(v)dv  *  a^  (20) 

Alternative  a‘  dominates  alternative  a1  in  terms  of  variance  if  the  variance 
associated  with  alternative  i  is  less  than  that  associated  with  alternative  j,  or 

<r)  =  dt;  -  a?  s  J  v2fj(v)  dv  a).  (21) 

When  an  alternative  dominates  another  alternative  in  both  expectation  and 
variance,  it  is  said  to  dominate  it  in  an  EV  domination  sense.  Generally, 
domination  in  either  expectation  or  variance  is  not  necessarily  meaningful. 
And  even  EV  domination  is  a  less  valuable  concept  than  the  various  stochas¬ 
tic  dominance  concepts,  in  that  one  can  easily  configure  problems  for  which  a 
non  preferred  alternative,  that  is  one  either  stochastically  dominated  by 
another  alternative  or  with  a  lower  expected  utility  than  another  alternative, 
may  dominate  another  alternative  in  an  EV  domination  sense  (28).  Thus  the 
EV  domination  concept  must  be  used  with  caution. 

As  an  example  of  sensitivity  calculations  which  use  stochastic  domination 
concepts,  we  consider  the  problem  posed  by  Table  II. 


Table  II. 

Probability  of  occurrence  of  various  event  outcome  states 


Alternative 

x, 

v(x,)  =  0 

Xj 

«(*,)  =  0.25 

State 

x, 

v(x,)  =  0.5 

x . 

v(x,)  =  0.75 

x, 

v(x,)=  1.0 

a' 

0.25 

0.25 

0.25 

0.25 

0 

a 1 

0 

0.25 

0.25 

0.25 

0.25 

a’ 

0.15 

0.15 

0.20 

0.25 

0.25 

a4 

0.20 

0.80 

0 

0 

0 

a 5 

0.50 

0 

0 

0 

0.50 

a* 

0 

0 

1.0 

0 

0 

Also  shown  are  cardinal  values,  which  are  used  in  some  calculations. 


For  first  order  stochastic  dominance  we  have,  from  (16),  the  first  order 
stochastic  dominance  reachability  matrix  and  digraph  (21)  shown  in  Fig.  3. 
Note  that  we  need  only  use  the  ordinal  preferences  information  among  state 
values  to  determine  this  domination  relationship. 

We  must  know  cardinal  values  in  order  to  use  second  and  higher  order 
domination  relations,  however.  Bounds  on  these  values  can  be  utilized,  and 
we  can  consider  multivariate,  multi-attribute  outcomes,  as  discussed  in  (27). 
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a'  a2  a3  a4  a5  a6 
a* 
a2 
a3 
a4 
as 
a4 

Fig.  3.  Reachability  matrix  and  minimum  edge  digraph  for  first  order  stochastic 

domination. 

(28)  and  (29).  Unfortunately,  this  requires  resolution  of  a  number  of  linear 
programs  and  this  can  be  computationally  rather  unattractive.  If  we  use  the 
cardinal  values  specified  in  Table  II,  it  is  a  simple  matter  to  use  (17)  or  (18)  to 
obtain  the  reachability  matrix  and  minimum  edge  digraph  shown  in  Fig.  4. 
Note  that  first  order  stochastic  dominance  ensures  second  order  stochastic 
dominance.t  Thus,  there  is  no  need  to  determine  dominance  for  the 
dominated  relations  of  Fig.  3.  From  Fig.  3  we  see  that  the  only  possible 
dominance  relations  which  we  need  check  are 

a 1  vs  a*,  a5,  a4 
aJvs  a5,  a4 
aJvs  a5,  a4 
u4vs  a5 
a5vs  a4. 


Fig.  4.  Reachability  matrix  and  minimum  edge  digraph  for  second  order  stochastic 

dominance. 


tStochastic  dominance  of  order  n  guarantees  stochastic  dominance  of  order  greater 
than  n. 
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From  these  candidate  relations  we  determine  that 

a2>1ai,  ai>1as,  at>1ai 

and  these  are,  of  course,  shown  in  Fig.  4. 

For  infinite  order  stochastic  dominance  we  easily  see,  from  Table  II,  that 

a1'-  a* >  .a3  >  ,aJ  >  ,a'  >  ,a5 

and  this  dominance  pattern  is  illustrated  in  Fig.  5.  This  dominance  digraph 
indicates  that  the  best  two  alternatives  are  a2  and  a4;  just  as  did  the  second 
order  stochastic  dominance  effort.  But,  infinite  order  stochastic  dominance 
results,  effectively,  in  a  maximization  of  the  probability  that  the  alternative 
selected  will  result  in  other  than  the  minimum  return.  It  can  be  a  rather 
pessimistic  criterion,  therefore.  It  may  well  turn  out  that  alternative  a3  is 
preferred  to  alternative  a4  for  a  more  realistic  utility  function. 

We  next  examine  EV  domination  and  easily  establish  the  results  shown  in 
Fig.  6.  From  this  figure  we  indeed  see  that  domination  based  on  expectation 
only  is  a  poor  indicator  to  use  for  choicemaking.  Although  the  EV  dominance 
digraph  shown  in  Fig.  6  is  slightly  different  from  that  obtained  using  the 
second  order  stochastic  domination  results,  it  does  indicate  that  the  best  three 
alternatives  are  a2,  a1,  a*. 

To  determine  the  final  choice  alternative  we  might  assume  a  standard 
exponential  relationship,  expressing  constant  risk  aversion  r,  to  relate  utility 
and  value.  Here  we  will  use 


u(v)~ 


l-e" 

1-e"’ 


The  expected  utilities  for  alternatives  a2,  a3,  a4  are  easily  determined  for 
various  r  as  shown  in  Fig.  7.  There  is  no  way,  of  course,  that  a 3  can  be 


FlG.  5.  Reachability  matrix  and  minimum  edge  digraph  for  infinite  order  stochastic 

dominance. 
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Meon  Variance 
o* 
a* 
a* 
a4 
os 
a* 

(a)  Mean  and  variance  values  for  example 


0  375 

07813 

0625 

0.7813 

0.575 

011938 

0.2 

0  01 

0.5 

0.25 

05 

0 

<b)  Domination  based  on 
expectation  only 


fc )  Domination  based  on 

expectation  ond  variance 


Fig.  6.  EV  dominance  results. 


Fig.  7.  Sensitivity  effect  of  risk  aversion  coefficient  in  determining  best  alternatives. 
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the  preferred  alternative  since  it  is  dominated  by  a1,  a *  can  be  either  the  most 
preferred,  the  second  most  preferred,  or  the  third  most  preferred  alternative 
depending  upon  the  amount  of  risk  aversion.  Fig.  7  indicates  transition  points 
where  the  various  optimum  decision  alternatives  change. 

IV.  Sensitivity  in  Scalar  Multiple  Attribute  Utility  Analysis 

Much  contemporary  emphasis  has  been  placed  on  the  evaluation  of  alter¬ 
natives  using  multiple  attribute  utility  theory.  The  numerical  utility  that 
results  from  use  of  multi-attribute  utility  theory  depends  upon  the  structure  of 
the  multiple  attribute  utility  function,  the  scaling  coefficients  within  this 
structure,  and  the  individual  single  attribute  utility  functions  which  are 
aggregated  to  determine  the  multiple  attribute  utility  functions. 

Fishburn  (8,9)  has  considered  approximations  of  scalar  multi-attribute 
utility  functions  in  which  u(x)  is  a  continuous  real  valued  scalar  cardinal 
utility  function  and  v(x)  is  an  approximation  for  u(x).  A  number  of  ap¬ 
proximations  to  u(x)  of  the  general  form 

uU)  =  r(x,,  xJf . . . ,  x„)  =  ]£  /,  (*,)/,  (xj) . . .  /  (xj 

/-I  1 

are  considered.  A  distance  metric  in  the  form  of  the  uniform  norm 

D(u,  v)  =  sup  |«(x)  -  u(x)| 

is  minimized.  Among  the  results  of  these  efforts,  the  following  are  especially 
significant: 

(1)  An  additive  utility  function  u(x)  can  be  approximated  to  arbitrary 
closeness  by  the  multiplicative  form 

v(x) = n  »(*«> 

i-l 

(2)  If  u(x)  is  multiplicative,  then  there  is  a  lower  bound  on  the  distance 
between  the  actual  utility  and  an  additive  approximation. 

One  of  the  interesting  conclusions  of  this  effort  is  that  simple  additive 
approximations  may  function  as  well  as  the  more  complicated  multiplicative 
approximations  for  cases  in  which  the  true  utility  function,  u(x),  is  neither 
multiplicative  nor  additive. 

Much  effort  has  been  devoted  to  parameter  sensitivity  in  deterministic 
additive  models.  Among  the  useful  results  obtained  from  these  studies  is  the 
indication  that  differential  weighting  of  attributes  is  often  not  necessary  and 
that  equal  weighting  may  perform  essentially  as  well.  We  caution  that 
differential  weighting  is  needed,  however,  if  alternatives  are  of  nearly  equal 
value.  I.eung  (14)  provides  a  survey  of  much  of  this  work  with  a  number  of 
references  to  contemporary  literature. 

Among  the  more  useful  of  sensitivity  type  results  that  can  be  established 
for  multi-attribute  decisionmaking  under  certainty  are  various  types  of 
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dominance  results  for  the  case  where  attribute  scores,  in  the  range  0  to  1,  can 
be  established  for  each  alternative.  In  the  most  unspecified  case  nothing  is 
known  about  the  n  weights  for  an  assumed  linear  multi-attribute  utility 
function  except  that 


w,  =■  0,  i  =  I,2 . n 

(22) 

2>.*i 

iwi 

(23) 

n  n 

ul  =  u(af)  =  wTu*  =  5)  wmAci*)  =  5)  wtu[. 

(24) 

• 

If  it  turns  out  that  uj  2  uk  Vi,  with  the  inequality  holding  for  at  least  one  /, 
then  we  easily  see  that  alternative  j  must  have,  regardless  of  the  weights,  a 
greater  utility,  u(a‘ ),  than  alternative  k.  We  say  that  a'  dominates  ak.  If  we 

have,  for  example.  p 

u'  =  0.2  w,  +0.2wj 
u1  =  0.5  w,  +  0.2  ms 
mj  =  0.3  tv,  +  0.2wi 

u*  -  0.5  w,  +  Ow;  P 

we  see  that  a'>u\  az>a},  and  a*>a*  for  any  w>,,  tv,  subject  to  (22) 
and  (23).  Figure  8  illustrates  these  four  utilities  and  the  associated  dominance 
relations.  We  see  from  this  figure  that  there  is  no  dominance  of  alternative  3 
by  alternative  I ;  nor  is  there  dominance  of  alternative  3  by  alternative  4.  Yet 

we  see  that  there  are  no  values  of  the  weights  such  that  aJ  is  preferred  to  a1  f 


(0)  Utilities  os  a  function  of 
OffnDufe  weights 


(6)  Domination  digraph 


O  6 


CM 

*04 


<02 


0  2  04 

Attribute  I 


06 


(c)  Value  scores 


Fig.  8.  Preference  relations  for  a  simple  example. 
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and  a4.  We  may  establish  this  fact  by  noting  that  the  requirements  for  a 5  >  a\ 
which  is  w,  a  w2,  and  a1  >  a4,  which  is  w2  a  2wt,  are  inconsistent. 

In  the  general  case  where  utilities  are  defined  by  (24)  and  the  constraints  of 
(22)  and  (23)  hold,  we  can  show  that  alternative  k  will  be  dominated  by  a 
mixed  strategy  of  the  (m  - 1)  remaining  alternatives  if  there  is  a  non  zero 
(positive)  solution  /  to  the  linear  programming  problem 


J  =  min  2  d4,  wf>0,  j  — 1.2 . n  (25) 

i-i 

i+k 

2>,=  1,  d)  a 0,  /=1,2 . (26) 

2>,(^-uj)  +  d<  aO,  7*1,2 . (27) 

When  we  compare  alternative  3  with  a  mixed  strategy  of  alternatives  l  and  4, 
for  the  alternatives  of  Fig.  8,  we  see  that  the  foregoing  relations  become 

J  =  min  {d]  +  d\) 
wt  a  0 
W;>0 
W>,  +  W2  =  1 

dJaO 
d\>  0 

0. 1  w,  -  0. 1  Wj  +  d]  a  0 
—  0.2w,  +  0. 1  tvj  +  d\  a  0. 


The  solution  to  this  linear  programming  problem  is 

d]  -  0.1  -0.2iv,  V  w,£  0.5 
d\  =  0.3  w,  -0.1  V  w,  a  0.33. 

We  see  that  there  is  a  non  zero  J  over  the  entire  range  of  w,  and  thus  note 
again  that  alternative  3  is  dominated  by  a  mixed  strategy  of  alternatives  I  and 
4. 

In  many  cases  it  will  be  possible  for  the  decisionmaker  to  express  ordinal 
weights,  or  bounds,  on  the  weights  wf  in  the  form 

tv,  a  a  •  •  •  w,  a  0.  (28) 
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Suppose  also  it  turns  out  that 


«f  =  +  e, 

ui  = 

u{  =  uf  +  e,  -  ej 
u{  =  uii+e,~ 
ui^ul  +  e,- 

where  ff>0  Vi.  Then  we  have  for  the  utility  of  alternative  j 

u‘  =  2  **’•“! =  2  +  «.■ -  «(-i) 

1-1  1-1 

where  co  -  0.  We  can  write,  by  changing  the  summation  index, 

N  «-l 

2  **'•«.-!  =  2 
i - I  i*0 

such  that  (29)  becomes,  using  (24). 

#1-1 

«'  -  ul  +  2  «<(**i  -  w,>,)  +  e„wv 

i-l 


(29) 


(30) 


Since  we  know  that  e,  >0  and  tv,  2:  tvitl  sO,  we  have  established  the  fact  that 
if  the  equalities  of  (29)  hold,  we  must  have  a '  >  a‘  regardless  of  the  value  of 
the  weights.  Equation  (29)  is  not  in  the  form  most  suited  for  actual  use  and 
can  easily  be  rewritten  in  terms  of  the  cumulative  difference  inequality 


2“'22m'*  m  =  1,2, .... n  (31) 

#-l  l«l 


which  is  in  a  form  quite  suitable  for  actual  use. 

For  the  four  alternatives  and  utilities  considered  earlier  in  this  section  we 
still  have  a 2  >  a\  a1  >  a 1  and  aJ  >  a*.  We  also  have  a*  >  a\  o’  >  a1,  and  the 
implied  transitive  preference,  a*  >  a 1  as  well.  In  this  particular  case,  specifyingan 
ordinal  scale  for  the  attribute  weights  has  completely  ordered  the  (dominance) 
preference  relationship.  As  indicated  in  Fig.  9,  the  imposition  of  the  constraint 
tv,  >  tv,  simply  eliminates  the  right  half  of  the  space  in  Fig.  8  where  tv,  >0.5. 

Even  though  alternative  k  may  not  he  dominated  by  alternative  /,  it  may  or 
may  not  always  have  a  lower  utility  than  the  mixed  strategy  of  alternative  i  or 


V<»l  112.  N«.  1/4.  pp  26J-29I.  Scftemtwf /October  1911 
Prime*  m  Grcx  Bnuie 


281 


Andrew  P.  Sage 


i - 1 _ i 
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(o)  Util  it  iti  as  a  function  of. 
ottriOuts  mmqht*  for 


(b)  Domination  dtQropft 
•ith  w,>»* 


Ob, 


n 

o 


0  0  2  0.4  Ob 


Utility,  »,•  l.O,  «^*0 


(c)  Valu#  sooros  for  attnburos, 
wtmm>  0.5 


Fig.  9.  Preference  relations  for  a  simple  example,  w,  a  w7. 


alternative  j.  For  example  in 


us  =  0.6*v,  +  0.4w2 
u4  =  0.3  tv,  +  0.9w, 
u7  =  0.7  h»,  +0.2»v, 

we  see  that  alternative  5  is  not  dominated  by  a  mixture  of  alternatives  5  and  7  if 
<■>1  s  <u2.t  However,  in  order  to  have  a5  >  a4  and  a5  >  a7  we  must  have 


w,  >  w. 

0.6  w,  +0.4wja0.3*V|  +  0.9w2 
0.6w,+0.4h'j>0.7m'i  +  0.2w2 


or 


1.67  tv.  <  W|  s  2iv: 


or,  since  w2  =  1  -  w,. 


5/8  £  w,  <  2/3. 

Thus,  dominance  of  a5  over  a4  and  a7  is  not  guaranteed  except  over  a  small 
range  of  w,.  On  the  other  hand  if  we  have 

u*  =  0.8  w,  +  0. 1  tv. 

tlf.  it':  >  w,  then  alternative  6  dominates  alternative  5  as  can  be  shown. 
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then  we  will  have  a 1  >  a 4  and  a5  >  a*  only  if 

1.67*2  £W|S  1.5*2 

and  this  is  inconsistent.  Thus  alternative  5  cannot  be  the  alternative  with  the 
highest  utility  in  that  the  utility  of  alternative  6  or  alternative  8  is  always 
greater  than  this.  Figure  10  illustrates  preference  relationships  among  alter¬ 
native  5,  6,  7  and  8  as  obtained  here. 

For  the  general  case  where  the  attribute  weights  are  ordered  as  in  (28),  it 
turns  out  that  alternative  k  will  be  dominated  by  a  mixed  strategy  of  the 
(m  - 1)  remaining  alternatives  if  there  is  a  non  zero  solution  /  to  the  linear 
programming  problem 

m 

J  =  min  ^  dkh  w,  5:  w2  ^  *  •  •  >  wn  >  0 

Si 

i*k 

d)>  0,  /  =  1,2 . +  (32) 

»*i 

y  *f(« j -ui)  +  dki  a 0,  j  =  1,2 . A:  -  1,  A:  +  1 . m. 

There  have  been  a  number  of  sensitivity  studies  of  multi-attribute  utility  in 
the  psychological  literature  (5-5,24,30)  and  the  effect  of  errors,  including 
cognitive  bias  induced  errors,  upon  risk  and  uncertainty  estimation  (22).  A 
major  goal  of  this  psychological  research  is,  a  theory  of  errors.  This  will  allow 


Fig.  10.  Utilities  as  functions  of  attribute  weights.  Note  that  a  mixed  strategy  of 
alternatives  8  and  6  may  always  be  better  than  alternative  5  or  7. 
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determination  of  the  effects  of  poor  structuring  of  decision  situation  models 
and  poor  elicitations  of  values  and  uncertainties  and  the  aggregation  of  these 
into  decision  rules.  A  hoped  for  achievement  of  all  this  research  is  a  theory 
that  explains  and  clarifies  descriptive  and  prescriptive  approaches  to  sub¬ 
stantive  and  procedural  judgment  and  decision  processes  such  as  to  enable 
the  design  of  more  efficacious  systems  for  planning  and  decision  support.  In 
this  section  we  have  indicated  how  sensitivity  results  can  be  used  to  this  end, 
and  how  sensitivity  analysis  can  be  used  to  reduce,  often  considerably,  the 
needed  number  of  precise  weights.  This  should  generally  reduce  the  potential 
cognitive  stress  involved  in  decision  analysis  efforts.  Some  rather  general 
results  concerning  partially  identified  parameters  and  associated  sensitivity 
analysis  for  planning  and  decision  support  are  given  in  (28). 


V.  Sensitivity  and  the  Structure  of  Decision  Situation  Models 

Sensitivity  analysis  results  can  be  used  to  guide  the  structuring  of  decision 
situations.  This  has  been  the  thrust  of  recent  efforts  by  Leal  et  al.  (13, 16); 
Merkhoffer  et  al.  (15);  and  Rajala  and  Sage  (17-20).  Of  interest  also  is  the 
related  work  of  Chen  and  Jarboe  (2);  Haruna  and  Komoda  (10);  and  Howard 
et  al.  (11). 

Use  of  sensitivity  measures  to  guide  the  structuring  of  decision  trees,  and 
related  structures  such  as  fault  trees,  requires  the  availability  of  preference  or 
utility  measurements  for  event  outcomes  and  uncertainty  measures  over 
events.  There  are  four  concepts  of  value  in  structuring  decision  trees  using 
sensitivity  concepts: 

(1)  sensitivity  differential  of  a  node, 

(2)  relative  sensitivity  differential  of  a  node. 

(3)  expected  value  of  resolving  residual  uncertainty  and 

(4)  decision  sensitivity  to  outcome  variable  uncertainty  resolution. 

The  sensitivity  differential  of  a  node,  A,  is  the  change  that  must  occur  in  the 
value  of  that  node  in  order  to  cause  a  change  in  the  currently  best  initial 
decision.  In  Fig.  1 1  for  example,  a  decrease  in  the  value.t  or  utility,  v(x,  d)  at 
node  B  of  more  than  0.95  units  will  cause  the  best  initial  decision  to  switch 
from  a‘  to  a1.  It  would  require  a  decrease  of  -0.125  units  in  the  value  at  node 
E.  for  example,  for  this  to  happen.  A  recursive  relation 


A  (i)  = 


A(i  -  I) 

Pi  ' 


node  i  is  an  event  node 


A(i  -  1)  +  Vj-i(x)  -  vt(x).  node  i  is  a  decision  node 


may  be  determined  (13).  Here  A(i)  is  the  sensitivity  differential  associated 
with  node  i  and  A(i  -  I)  is  the  sensitivity  differential  of  the  preceeding  node. 
t>,(.t)  and  e,_,(x)  refer  to  the  expected  values  at  nodes  i  and  i-  l. 


tWe  use  the  value  symbol  for  convenience.  All  of  the  discussion  in  this  section  applies  to 
utilities  as  well  as  to  values. 
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y  •  1.0 
A«  -0.125 


v  •  0.5 
A*-0  167 


y  •  0 

A- -0.167 


y  »  I  0 
A-0  75 

y-0  5 
A-0  375 

v  *0 

A*0  375 


y  -I  O 
A-0  125 

v  O  5 
A* 0  25 


v  •  0 
A-0  125 


Fig.  II.  Decision  tree  with  expected  (rollback)  values  and  sensitivity  differentials. 
The  relative  sensitivity  differential  of  node  /  is  given  by 


s,(i)  = 


<r,(i ) 

Mi) 


where  irt(i)  is  the  anticipated  change  in  the  value  at  node  i  which  may  result 
from  further  refinement.  Unfortunately  there  is  no  general  way  to  determine 
<r,(i)  except  by  elicitations  from  the  decision  maker.  It  is  reasonable  that  o-„(f) 
is  monotone  increasing  with  increases  in  U;(x)  since  greater  inaccuracies 
typically  are  associated  with  larger  values. 

The  expected  value  of  resolving  residual  uncertainty  (EVRRU)  may  be 
easily  computed  (IS).  We  assume  that,  in  Fig.  12,  the  current  best  decision  is 
[a1,  a4].  The  following  results  are  obtained: 

(1)  The  EVRRU  is  zero  if  we  consider  a  node,  such  as  node  I,  in  which  the 
node  is  along  a  path  leading  from  the  current  best  initial  decision,  a',  but  not 
the  best  current  decision  fa1,  a4|. 

(2)  The  EVRRU  is  zero  if  wc  consider  a  node  such  as  node  2,  in  which  the 
node  is  along  a  path  leading  from  the  current  best  initial  decision,  a1,  but 
where 


p,(i(x.  a1,  a*)  -  t  (x.  a'.a')|^  t  (x.  a')-n(.r.  a:). 
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Fig.  12.  Prototypical  decision  tree  for  computation  of  the  expected  value  of  resolving 

residual  uncertainty. 

(3)  For  case  2.  the  EVRRU  is  given  by 

EVRRU  =  PJ>if[v\x)  +  A  -  m;l 

where 


/  =  prob  [o*J(x)  =£  v2(x)  +  A] 
ml  =  £{t>*2(x)|e**(x)  2£  v(x)  +  A) 

if  the  inequality  in  case  2  is  reversed. 

(4)  If  we  consider  node  3  which  is  not  along  the  path  leading  from  the  best 
initial  decision,  then  we  have 


EVRRU  =  ~PLPmg[v\x)  +  A-m*] 


where 


g  =  prob{u*3(x)  2  p3(x)  +  AJ 
m*  =  E[o*J(x)|p*3(x)>  t>(x)  +  AJ. 

Rajala  and  Sage  (18)  have  developed  a  9-step  tree  expansion  structuring 
procedure  based  upon  these  sensitivity  relations.  Steps  in  this  procedure  are: 

(1)  Identify  the  initial  decision  alternatives  and  represent  them  by  branches 
emanating  from  the  first  decision  node. 

(2)  Identify  state  variables  of  importance  in  determining  the  value  of  each 
alternative. 

(3)  Elicit  a  value  or  utility  function. 

(4)  F.neode  provisional  probability  distributions  on  each  state  variable  for 
each  alternative  course  of  action. 
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(5)  Using  the  value  model  compute  probability  distributions,  /  and  g,  on  the 
rollback  value  at  the  terminal  nodes  and  each  interior  node  using  the  state 
variable  distributions. 

(6)  Determine  the  next  appropriate  node  for  expansion.  Either  the  EVRRU 
and/or  the  relative  sensitivity,  sr(i),  is  appropriate  as  an  aid  in  this  deter¬ 
mination.  If  either,  or  both,  of  these  are  below  some  threshold 
for  all  remaining  modes  we  stop  expansion  of  the  tree.  Otherwise  we  go  to  Step  7. 

(7)  The  sensitivity  of  the  current  best  initial  decision  to  uncertainty  resolu¬ 
tion  in  each  state  variable  is  determined.  Multi-attribute  utility  functions  are 
especially  appropriate  to  aid  in  this  task. 

(8)  We  verify  that  the  best  course  of  action  may  be  affected  by  incorporat¬ 
ing  factors  determined  in  Steps  6  and  7  into  the  decision  model.  Often  this  can 
be  accomplished  by  determining  whether  the  event  probability  required  for  a 
decision  switch  converges  to  an  amount  less  than  or  equal  to  the  amount 
elicited  from  the  decisionmaker.  If  it  does  we  go  to  Step  9.  If  it  does  not  we 
return  to  Step  7  and  repeat  this  step  until  we  are  convinced  that  no  switch  in 
the  decision  is  feasible. 

(9)  Incorporate  relevant  features  in  the  decision  tree  to  obtain  a  new  and 
improved  representation  of  the  decision  situation.  We  return  to  Step  4  and 
continue  the  process  until  the  EVRUU  and/or  s,(i)  are  sufficiently  low  at  all 
remaining  nodes  such  that  we  conclude  that  no  further  improvement  in  the 
decision  situation  structural  model  is  feasible. 

We  shall  limit  our  discussion  concerning  the  value  of  information  measures 
to  a  primary  decision  situation  that  involves  only  a  single  decision  d  whose 
uncertain  outcomes  are  represented  by  the  discrete  state  variables 
(x„...,x„).  The  uncertainty  on  this  state  vector  x  is  encoded  in  the  dis¬ 
tribution  f(x)  and  the  value  of  the  outcome  is  measured  by  the  value  model 
v(x.  d). 

The  purpose  behind  considering  the  possibility  of  acquiring  additional 
information,  given  this  complete  model  of  the  primary  decision  situation,  is  to 
determine  the  worth  of  eliminating  remaining  uncertainty  on  the  state  vari¬ 
ables.  An  important  quantity  which  establishes  an  upper  bound  to  the  amount 
that  the  decisionmaker  should  pay  to  eliminate  ail  uncertainty  on  a  state 
vector  is  the  value  of  perfect  information. 

If  a  clairvoyant,  an  individual  capable  of  indicating  the  exact  outcome  of  an 
uncertain  quantity,  were  to  report  to  the  decisionmaker  that  a  particular  state 
vector  x‘  would  occur,  then  the  decisionmakers  could  select  the  appropriate 
course  of  action  </*  that  gives  the  maximum  value,  denoted  by  v(x',  dt). 
However,  since  the  decisionmaker  does  not  know  what  x'  the  clairvoyant 
would  report,  the  value  that  would  be  realized  from  a  particular  outcome  must 
be  weighted  by  the  probability  that  the  outcome  will  be  reported.  The 
probability  that  is  assigned  is  just  prior  probability,  fix').  To  the 
decisionmaker,  the  expected  value  of  the  decision  situation  with  perfect 
information  is 

«  E[v(x.  </,)]  =  2  f(x')v(x\Jt). 

I 
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The  well  known  expected  value  of  perfect  information,  EVPI,  which  is  a 
measure  of  the  upper  bound  the  decisionmaker  should  be  willing  to  pay  to 
resolve  all  uncertainty  on  a  state  vector  x,  is  the  difference  between  the 
quantity  determined  in  the  equation  above  and  the  expected  value  of  the 
optimal  course  of  action  based  only  on  information  encoded  from  the 
decisionmaker’s  prior  knowledge  and  experience,  that  is 


EVPI  =  E[v(x,  </*)]  -  max  E[v(x,  d )] 

4 

~  2  f(x‘)v(xk,  di)  -  max  J  f(x‘)v(xk ,  d). 

I  d  i 


The  magnitude  of  EVPI  can  assist  the  analyst  in  determining  the  level  of 
effort  to  be  directed  toward  identifying  and  organizing  information  gathering 
decisions  into  the  decision  model.  A  lower  magnitude  of  EVPI  generally 
warrants  a  lower  level  of  structuring  activity.  These  methods  provide  a  basis 
which  allows  the  analyst  to  prompt  the  decisionmaker  into  identifying  in¬ 
formation  gathering  alternatives,  with  EVPI  providing  additional  incentive  to 
the  decisionmaker.  The  expected  value  of  information  from  these  methods  is, 
of  course,  bounded  above  by  EVPI,  assuming  no  structural  modelling  errors. 

The  information  z  obtained  about  the  state  vector  x  from  an  information 
gathering  alternative  causes  the  decisionmaker’s  experience  and  knowledge  to 
change,  and  its  effect  may  be  completely  accounted  for  by  a  revision  in  the 
probability  distribution  on  x.  The  revised  distribution  on  x  is  determined  from 
Bayes’  rule 


f(x\z)  = 


/(z|x)/(x) 

f(z) 


where  the  probability  functions  are  appropriately  defined.  The  expected  value 
of  information,  EVI,  is  the  difference  between  the  optimal  course  of  action 
with  additional  information  and  the  optimal  course  of  action  without  ad¬ 
ditional  information.  It  is  computed  as 


EVI  =  E.fmax  £{j>[x,  d(z,  c,)]}]  -  max  E[ v(x,  </)] 

«  J.  f,l  4 

=  2  [max  2  /(x|z)i>(x,  d(z,  c,)jl/(z)  -max  2  f(x)v(x,  d) 
7  L  Jl/.f  .l  .-  J  d  x 


where  d(z,c.)  indicates  the  primary  decision  d  is  based  on  information  z 
obtained  at  cost  c..  If  EVI  is  positive,  then  the  expected  value  of  the  decision 
situation  will  increase  when  the  secondary  decision  to  gather  additional 
information  is  made.  If  EVI  is  negative,  the  expected  value  will  decrease, 
reflecting  that  information  costs  more  than  it  is  worth.  If  c.  =  0,  then  EVI 
cannot  be  negative  since  it  is  never  harmful  mathematically  to  obtain 
additional  information. 
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Rajala  and  Sage  (17-20)  present  several  examples  of  these  procedures. 
These  approaches  are  especially  capable  for  use  as  structuring  tools  to 
determine  parsimonious  decision  trees  which  are  reflective  of  the  decision¬ 
maker’s  perception  of  the  decision  situation.  Also,  the  approach  provides  a 
general  method  to  use  in  “pruning"  already  structured  trees.  Of  particular 
interest,  in  this  connection,  would  be  the  ability  to  deal  with  multi  parametric 
sensitivity  issues  (25). 

VI.  Conclusions 

This  paper  has  presented  a  discussion  of  contemporary  efforts  involving 
error  and  sensitivity  analysis  of  decision  analysis  algorithms  for  evaluation 
and  choicemaking  associated  with  planning  and  decision  support.  We  have 
examined  sensitivity  to  probability  estimation  errors,  sensitivity  to  utility 
elicitation  errors,  sensitivity  to  variations  in  the  structure  and  parameters  of 
multi-attribute  utility  functions,  and  sensitivity  to  variations  in  the  structure 
as  well  as  the  probability  and  utility  parameters.  This  structural  sensitivity  to 
expansion  of  the  decision  tree  is  especially  useful  in  that  it  provides  an  aid  in 
the  determination  of  parsimonious  models  of  decision  situations. 

Our  recent  research  has  also  concerned  a  mixed  scanning  based  planning 
and  decision  support  system  which  involves  a  vector  multiple  attribute  utility 
function  (26. 27).  In  this  approach,  which  is  believed  behaviorally  relevant,  we 
intentionally  avoid  elicitation  of  all  possible  parameters  and  only  elicit  those 
which  can  be  shown  to  be  most  beneficial  in  increasing  the  domination  pattern 
among  alternatives.  Sensitivity  results  of  the  type  obtained  in  this  paper  have 
been  found  useful  in  guiding  the  partial  aggregation  of  values.  This  results  in  a 
planning  and  decision  support  system  in  which  the  parameter  weight  eli¬ 
citation  procedure  is  guided  by  an  interaction  process  involving  the  judgement 
an.  desires  of  the  decision  maker  and  suggestions  concerning  the  efficiency  of 
value  aggregation  that  are  determined  by  sensitivity  analysis  approaches. 
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ABSTRACT 

In  this  paper,  we  examine  a  single-stage,  multi¬ 
objective  decisionmaking  problem  under  uncer¬ 
tainty.  The  decisionmaker  can  select  any  one  of  a 
finite  number  of  alternatives  that  are  assumed  to 
have  been  identified.  After  any  alternative  is 
chosen,  one  of  a  finite  number  of  outcomes  will 
result.  With  each  outcome  is  associated  a  number 
of  criteria  or  attributes.  Cardinal  preference 
relations  across  the  set  of  possible  outcomes  have 
been  elicited  from  the  decisionmaker  for  each 
attribute  criteria.  No  attempt  to  tradeoff  cri¬ 
teria  is  necessarily  assumed.  The  probabilistic 
relationship  between  each  alternative  and  each 
outcome  is  presumed  to  be  known.  The  decision¬ 
maker  is  risk  averse.  Our  objective  is  to  deter¬ 
mine  the  smallest  subset  of  alternatives  that  is 
guaranteed  to  contain  the  most  preferred  alterna¬ 
tive  on  the  basis  of  this  assumption.  The  achieve¬ 
ment  of  this  objective  enhances  evaluation  prior¬ 
itization  and  decisionmaking  since  alternative 
selection  is  generally  easier  if  made  from  a 
subset  of  the  alternative  set  rather  than  from  the 
entire  alternative  set. 

We  present  an  approach  which  achieves  this 
objective  and  which  has  computational  times  amen¬ 
able  to  interactive  decision  aiding.  We  make  use 
of  a  result,  due  to  Fishburn  and  Vickson,  which 
states  that  the  feasibility  of  a  certain  collec¬ 
tion  of  linear  equalities  and  inequalities  repre¬ 
sents  a  necessary  and  sufficient  condition  for  one 
alternative  to  be  weakly  preferred  to  another  with 
respect  to  the  second  order  stochastic  dominance 
(SSD)  relation.  The  approach  presented  here  uses 
transitivity  and  upper  and  lower  bounds  on  this 
relation  in  order  to  reduce  the  number  of  con¬ 
comitant  linear  programs  necessary  for  solution. 
The  lower  bound  is  provided  by  the  first  order 
stochastic  dominance  relation;  the  upper  bound  is 
given  by  a  relation  that  is  equivalent  to  the 
second  order  stochastic  dominance  relation  when 
certain  independence  conditions  hold.  An  example 
illustrates  results  of  using  this  approach. 


*This  research  has  been  supported  by  ONR  Contract 
N0014-80-C-0542. 


I .  INTRODUCTION 

Many  well-known  approaches  for  multiobjec¬ 
tive,  single-stage  decision  aiding  under  uncer¬ 
tainty  {1-3]  have,  in  part,  the  following  tasks 
associated  with  them: 

1)  Determine  the  utility  function  of  the 
decisionmaker  (DM). 

2)  Calculate  the  (subjective)  expected 
utility  for  each  alternative.  (We 
assume  throughout  that  the  outcome 
probabilities  as  a  function  of  alter¬ 
native  are  given.  These  may  be  objec¬ 
tive  or  subjective  probabilities  which 
obey  the  sum  to  one  property  that  have 
been  elicited  from  the  DM  or  otherwise 
determined) . 

3)  Select  the  alternative  having  the  larg¬ 
est  (subjective)  expected  utility. 

A  potential  difficulty  with  implementing  this 
approach  in  practice  is  that  complete  utility 
function  assessment  may  be  a  stressful  task  that 
requires  a  substantial  amount  of  time  and  effort. 
Additionally,  utility  assessment  can  require 
cognitive  perspectives  not  within  the  previous 
experience  of  the  DM,  and  this  can  be  a  source  of 
frustration  which  may  well  lead  to  results  of 
lower  quality  than  potentially  achievable.  A 
potentially  useful  tactic  for  reducing  these 
difficulties  is  to  use  a  less  than  complete  de¬ 
scription  of  a  multiple  attribute  utility  func¬ 
tion;  one  which  infers  the  maximum  amount  possible 
from  ordinal  preference  information.  The  various 
stochastic  dominance  procedures  14-6)  provide  a 
useful  approach  towards  achieving  this  goal. 

Less  than  a  complete  description  of  the 
utility  function,  however,  almost  invariably 
produces  less  than  a  total  ordering  on  the  al¬ 
ternative  set,  and  a  weaker,  partial  ordering  on 
the  alternative  set  usually  cannot  identify  the 
most  preferred  alternative.  A  partial  order  can, 
however,  identify  the  nondominated  set,  a  set  of 
alternatives  that  is  guaranteed,  under  mild  condi¬ 
tions,  to  contain  the  most  preferred  alternative. 
The  identification  of  the  nondominated  set  is 
often  quite  adequate  for  decision  aiding  | 7 ] .  The 


number  of  alternatives  in  the  nondominated  set  is 
dependent  on  the  amount  of  partial  preference 
information  known  18,9].  When  a  scalar  utility 
function  representing  a  complete  multiattribute 
assessment  has  been  identified,  there  is  but  one 
alternative  in  the  nondominated  set. 

The  apparent  fact  that  the  nondominated  set 
is  often  a  sufficiently  informative  aid  for  eval¬ 
uation,  prioritization  and  decisionmaking  has 
motivated  the  development  of  a  decision  aiding 
procedure  that  allows  the  mix  and  specificity  of 
tasks  associated  with  utility  of  value  function 
identification  to  be  adaptively  determined  by  the 
DM  (8,9).  Adaptive  determination  of  this  mix 
requires  that  the  time  necessary  to  determine  the 
impact  of  initial  or  additional  preference  infor¬ 
mation  on  alternative  order  specificity  be  small, 
due  to  the  substantial  constraints  that  are  often 
placed  on  the  available  time  of  most  DM's  such 
that  the  procedure  is  potentially  interactive. 
One  of  the  decision  aiding  procedures  presented  in 
(9]  is  based  on  second  order  stochastic  dominance 
(SSD)  and  hence  on  only  cardinal  preference  infor¬ 
mation  across  outcomes  for  each  attribute,  very 
incomplete  knowledge  concerning  tradeoff  weights 
among  noncommensurate  attributes,  and  the  often 
behaviorally  relevant  assumption  that  the  DM  is 
risk  averse.  A  straightforward  implementation  of 
this  SSD-based  decision  aiding  procedure  requires 
the  formulation  and  solution  of  P(P-l)  linear 
programs  for  a  problem  having  P  alternatives.  Our 
current  computational  experience  indicates  that 
such  an  implementation  almost  invariably  requires 
computation  times  that  are  unacceptably  large, 
even  for  small  problems,  for  interactive  decision 
aiding.  The  intent  of  this  paper  is  to  propose  a 
set  of  procedures  that  may  significantly  reduce 
the  computational  time  and  effort  necessary  to 
order  the  alternative  set  using  SSD,  thus  en¬ 
hancing  the  potential  of  the  SSD-based  approach  as 
an  interactive  decision  aiding  procedure. 

This  paper  is  organized  as  follows.  The 
problem  is  formulated  and  preliminary  results  and 
definitions  are  given  in  Section  II.  In  Section 
III,  we  state  and  investigate  conditions  that  may 
often  reduce  the  time  required  by  the  approach 
taken  in  (9)  to  order  the  alternative  set  using 
SSD.  Conclusions  are  presented  in  the  final 
section. 


II.  PROBLEM  FORMULATION  AND  PRELIMINARIES 

We  assume  that  the  DM  can  select  for  imple¬ 
mentation  any  one  of  P  predetermined  alternatives 

D 

from  the  alternative  set  fl  =  [nl ,  n  },  After 
an  alternative  is  implemented,  any  one  of  M  possi¬ 
ble  outcomes  will  occur.  There  are  N  objectives 

under  consideration.  Let  vm  be  the  predetermined 

th  n 

value  score  of  the  m  outcome  with  respect  to  the 

n  objective.  The  real  number  vra  is  isotone 

n 

(monotonical ly  nondecreas in*)  in  preference  with 
respect  to  the  n**1  objective;  that  is,  outcome  m* 


is  (weakly)  preferred  to  outcome  m  with  respect  to 

objective  n  if  and  only  if  v®  >  v®.  Let  V  =  {vm, 

m=l,  ...f  M},  the  set  of  all  value  score  vectors, 

where  vro  »  {v™,  v™} .  This  requirement  for 

1  N 

cardinal  preference  information  across  alterna¬ 
tives  for  each  attribute  can  be  relaxed  and  or¬ 
dinal  measurement  scales,  such  as  the  ratio  scale 
used  by  Saaty  (10,  pp.  53-64),  used  instead.  This 
simplifies  the  elicitation  task  and  does  not 
introduce  a  significant  possibility  for  error,  in 
most  instances.  Sensitivity  analysis  techniques 
(6)  could  be  used,  in  any  specific  case,  to  de¬ 
termine  possible  error  effects  of  ordinal  measure¬ 
ment  scales. 

The  probability  that  outcome  m  will  result  if 
P  d  tn 

alternative  7t  is  selected  is  np(v  ).  This  model 
of  the  decision  situation  in  which  the  outcome 
states  are  the  same  and  have  the  same  values  for 
all  alternatives  is  convenient  here,  but  not  at 
all  necessary.  We  could  also  model  the  decision 
situation  as  one  in  which  the  probability  of  a 
given  outcome  is  the  same  for  all  alternatives  and 
where  the  utility  or  value  of  the  outcome  state 
differs  across  alternatives.  Alternately  we  could 
model  the  decision  situation  as  one  in  which  both 
the  probability  of  a  given  outcome  and  the  value 
of  the  outcome  are  functions  of  alternatives.  All 
three  representations  may  be  shown  to  be  mathemati¬ 
cally  equivalent.  The  one  we  use  is,  we  believe, 
more  compelling  behaviorally  and  mathematically. 

We  assume  that  there  exists  a  presumably 
unassessed  utility  function  u:  V  ■»  R  which  re¬ 
flects  the  DM's  preferences  in  that  outcome  m'  is 
(weakly)  preferred  to  outcome  m  with  all  objec¬ 
tives  under  consideration  if  and  only  if  u(vm  )  > 

uCv™).  Alternatives  are  compared  on  the  basis  of 
(subjective)  expected  utility:  alternative  7i'  is 
(weakly)  preferred  to  alternative  71  if  and  only  if 
E(u,  71')  >  E(u,  7l),  where 

E(u,  n)  =  I  u(v)7t(v). 
veV 

We  make  only  the  following  three  assumptions 
about  the  DM: 

1)  The  DM  prefers  outcome  m’  to  outcome  m 

when  only  objective  n  is  considered. 
Let  this  statement  be  true  for  all 
n  =  1,  ..,  N.  Then,  the  DM  prefers 

outcome  m'  to  outcome  m  when  considering 
all  objectives  simultaneously  (consis¬ 
tency  of  ordinal  preferences). 

2)  The  DM  prefers  the  expected  consequence 
of  a  lottery  to  that  lottery  (risk 
aversion) . 

3)  The  DM  can  express  cardinal  value  pref¬ 
erences  across  outcome  states  for  each 
attribute.  As  previously  noted,  this 
assumption  cm  be  relaxed. 


These  three  assumptions  imply  that  the  DM's  scalar 
utility  function  is  isotone  and  concave,  respec¬ 
tively,  and  thus  is  a  member  of  the  set  U2  =  {u: 
u  is  isotone  and  concave}.  The  objective  is  to 
provide  the  DH  with  a  set  of  alternatives  which  is 
guaranteed  to  contain  the  most  preferred  alterna¬ 
tive  under  the  assumption  that  all  that  is  known 
about  the  DM's  scalar  utility  function  is  that  it 
is  a  member  of  U2. 

We  say  that  alternative  tt*  is  (weakly)  pre¬ 
ferred  to  alternative  Tt  with  respect  to  SSD,  i.e. 
n'R2ft,  if  and  only  if  E(u,  tt')  >  E(u,  tt )  for  all 
u  £  U2.  Thus,  if  the  DM  is  consistent  and  risk 
averse,  Tt'  R2  TT  implies  that  TT'  can  be  expected  to 
be  at  least  as  good  an  alternative  choice  as  TT. 
It  is  well-known  [8]  that  the  most  preferred 
alternative  is  a  member  of  the  nondominated  set 
{n  £  II:  there  does  not  exist  a  tt’  £  IT  such  that 
rt'R2  and  not  n  R2  tt'}.  Determining  the  nondom¬ 
inated  set  of  (1  with  respect  to  R2,  or  more  gen¬ 
erally  determining  the  set  P2£n  x  11,  where  (tt1  , 
Tl)  £  P2  if  and  only  if  Tl'  R2  Tl,  helps  to  restrict 
the  search  for  the  most  preferred  alternative, 
thus  presumably  aiding  decisionmaking.  (Note  that 
n  is  nondominated  if  there  is  no  n'  £  11  such  that 
(n1 ,  Ti)e  P2  and  (n,  n')t  P2;  thus,  knowledge  of  P2 
can  be  used  to  determine  the  nondominated  set  of  fl 
with  respect  to  R2.) 

The  following  necessary  and  sufficient  condi¬ 
tions  are  a  slightly  generalized  version  of  a 
result  presented  in  Fishburn  and  Vickson  [5],  and 
suggest  an  approach  for  determining  P2: 

THEOREM  1:  it’  R2  n  if  and  only  if  there  exists  a 
feasible  solution  to  the  set  of  linear  equalities 
and  inequalities: 

(i)  d.j  >  0  for  all  i,  j  =  1,  ....  M 

M 

(ii)  2  d..  =  1  for  all  i  *  1,  ...,  M 
j-1  lJ 

such  that  ti'(v1)  f  0 


rt(v^  )  =  2  tT  (v*)d .  . 


for  all  j  =  1,  . . . ,  M 


2  d.  .  vJ  <  vl 
ij  n  -  n 


for  all  i  =  1,  ...,  M  such  that 


A  brute-force  application  of  Theorem  1  for 
determining  P2  requires  the  formulation  and  solu¬ 
tion  of  P(P-l)  linear  programs,  each  having  up  to 
M(M  +  N  +  2)  decision  variables,  2M  of  which  are 
artificial  variables,  and  up  to  M(N  +  2)  side 
constraints.  Considerable  experience  with  the 
process  of  formulating  and  solving  these  linear 
programs  indicates  that  they  may  often  require 
computer  time  that  is  unacceptably  large  for 
interactive  decision  aiding,  even  with  relatively 
small  problems  and  a  relatively  fast  computer. 
For  example,  an  P=6,  M=5,  and  N=4  problem  required 
roughly  1.5  minutes  of  CPU  time  on  a  CDC-6400. 
Our  computations  were  done  interactively  in  a  time 
sharing  mode.  Turn  around  time  can  was  experi¬ 
enced  to  be  between  5  and  15  minutes,  depending  on 
the  system  load,  for  the  problem.  This  length  of 
time  seems  excessive  for  interactive  decision 
aiding  even  when  using  a  rather  fast  computer. 
The  motivation  to  use  microprocessors  in  planning 
and  decision  support  is  strong;  consequently  there 
is  much  motivation  to  seek  an  approach  to  deter¬ 
mining  nondominated  sets  that  are  associated  with 
reduced  computational  complexity.  In  the  next 
section,  we  present  bounds  on  SSD  and  associated 
theory  and  techniques  that  yield  a  strong  second 
order  dominance  result  which  will  reduce,  some¬ 
times  substantially,  the  computational  burden 
associated  with  standard  approaches  to  calculating 
SSD  relations. 


III.  MAIN  RESULTS 

In  the  previous  section,  a  procedure  for 
determining  P2  was  suggested  that  involved  a 
straightforward  application  of  Theorem  1.  In  this 
section,  we  present  several  results  that  will 
typically  reduce,  sometimes  substantially,  the 
computational  times  associated  with  this  pro¬ 
cedure.  These  results  are  presented  and  proved 
following  three  preliminary  definitions. 

1.  The  alternative  tt'  is  said  to  be  (weak¬ 
ly)  preferred  to  n  with  respect  to  first  order 
stochastic  dominance  (FSD),  ti'R,  tt,  if  and  only  if 
E(u,  Tt')  >  E(u,  Tl)  for  all  ueU1  =  {u:  u  is  iso¬ 
tone  } . 

2.  The  alternative  tt'  is  said  to  be  (weak¬ 
ly)  preferred  to  Tl  with  respect  to  strong-SSD 

(SSD),  i.e.  TT'R2  tt,  if  and  only  if,  for  each  n  = 
1,  ...,  N,  there  exists  a  feasible  solution  to  the 
set  of  linear  equalities  and  inequalities  (i), 
(ii),  (iii),  and 

M 


tt  '  ( v  )  f-  0  and  all  n  =  1,  ....  N. 

A  probabilistic  interpretation  of  { d ^ ^ }  is  given 

by  Fishburn  and  Vickson,  1 5 1  in  terms  of  a  prefer¬ 
ence  separation  between  TT  and  TT' .  Thus  the  d_ 

represent  domination  strength  between  alternatives 
on  the  various  value  dimensions. 


for  all  i  =  1 , . . 
tt'  (vl )  t  0 


.  ,  M  such  that 


3.  An  arbitrary  relation  on  Fl  is  said  to 

be  stronger  than  (more  precisely,  at  least  as 
strong  as)  an  arbitrary  relation  R^  on  fl,  i.e.  R^ 


C  R^,  if  and  only  if  n'R^  n  implies  n'  R.  n,  for 
any  pair  it' ,  rt  £  (1. 

We  remark  that  n'R2  rt  is  equivalent  to  N 
separate  checks  for  univariate  SSD,  for  which 
there  exists  a  computationally  simple  procedure 
[S,  Section  2.14].  We  also  note  that  under  cer¬ 
tain  independence  conditions,  presented  in  Theorem 
2.11  of  [5],  that  R2  -  R 2 1  or  R2  —  R2  and  R2  S  R2. 
We  now  present  our  main  result,  the  proof  of  which 
is  in  the  Appendix. 

THEOREM  2:  Rlf  R2,  and  R2  are  transitive,  and  Rt 

c  r2  c  r2 . 

The  impact  of  this  result  is  due  to  the  fact 
that  it  can  be  used  to  reduce,  often  drastically, 
the  number  of  linear  programs  that  require  solu¬ 
tion  in  order  to  construct  the  set  P2.  Transi¬ 
tivity  implies  that  it  is  not  necessary  to  check 
whether  or  not  n"  R  n,  if  n"  R  n*  and  n'  R  n,  for 
arbitrary  transitive  relation  R.  The_ relation  Rt 
£  R2  £  R2  implies  that,  once  Pt  and  P2  are  known 
where  we  define  Pt  and  P2  similarly  to  P2,  the 
only  pairs  that  require  the  linear  program  check 
in  order  to  complete  determination  of  P2  are  those 
pairs  in  P2  which  are  not  in  P1  and  which  have  not 
already  been  added  to  P2  by  the  above  transitivity 
argument.  Theorem  2,  therefore,  suggests  the 
following  four  step  procedure  for  determining  P2: 

(1)  Determine  Pj.  Relatively  simple  com¬ 

putational  procedures  for  determining  Pt 
are  presented  in  [9]. 

(2)  Determine  P2.  Relatively  simple  com¬ 

putational  procedures  for  determining  P2 
are  suggested  in  (5].  The  algorithms  of 
Theorem  1  may  also  be  used  for  this 
purpose  but  are  more  complex  than  need¬ 
ed. 

(3)  Evaluate  all  pairs  in  Pi  which  are  not 
in  P2,  using  Theorem  1. 

(4)  Construct  P2  by  adding  the  appropriate 
pairs  from  Step  3  to  P(. 

The  above  procedure  prompts  three  comments. 
First,  the  transitivity  of  all  relations  can  be 
useful  in  reducing  the  number  of  linear  program 
formulations  and  solutions,  a  fact  not  explicitly 
mentioned  above.  Second,  it  is  inconsequential, 
in  terms  of  substantive  results,  whether  Step  1  is 
performed  prior  to  Step  2.  Whichever  of  the  first 
two  steps  is  performed  first  can,  however,  impact 
on  the  time  required  to  perform  the  second  step. 
This  impact  is  due  to  the  facts  that  if  (rt' ,  n)  c 
P,,  then  (rt'  ,  n)  e  P2  and  if  (rt'  ,  n)  t  P2,  then 
(rt’ ,  rt)  f  P|,  since  P,£  P2.  It  should  be  possible 
to  construct  an  algorithm  to  determine  an  approach 
which  yields  maximum  transitive  inference.  But 
this  algorithm  might  well  require  greater  execu¬ 
tion  time  than  it  would  save.  Third,  in  checking 
for  strong-SSD,  it  is  necessary  to  examine  only 
down  to  the  first  objective  that  fails  to  satisfy 
the  univariate  SSD  criterion  (if  one  exists). 


We  now  present  an  example  illustrating  the 
above  procedure. 

EXAMPLE:  Consider  Example  3  in  (8].  In  that 
example  problem,  there  were  six  available  alter¬ 
natives,  five  possible  outcomes,  and  four  objec¬ 
tives  under  consideration  prior  to  the  objective 
aggregation  procedure,  i.e.  P=6,  M=5,  and  N=4. 
Table  1  presents  the  assumed  data. 

Table  1.  Data  for  the  Example 

Outcome  Number 

m=l  m=2  m=3  m=4  m=5 

n=l  10  5  5  0  5 

Objective  n=2  10  0  0  0  0 

Number 

n=3  3  3  10  0  3 

n=4  5  5  5  0  10 

(a)  Value  Scores  for  Each  Outcome  and  Objective 


Outcome  Number 


m=l 

m=2 

m=3 

m=4 

m=5 

P=1 

0.6 

0.1 

0.2 

0.1 

0.0 

p=2 

0.7 

0.0 

0.1 

0.2 

0.0 

p=3 

0.3 

0.1 

0.0 

0.4 

0.2 

p=4 

0.3 

0.0 

0.1 

0.1 

0.5 

p=5 

0.1 

0.1 

0.0 

0.1 

0.7 

p=6 

0.0 

0.1 

0.1 

0.0 

0.8 

(b)  Outcome  Probabilities  for  Each  Alternative 

Results  in  [8]  indicate  that  Pt  =  {(4,3)}.  Calcu¬ 
lations  based  on  procedures  suggested _in  Section 
2.14  of  (5]  or  our  Theorem  1  show  that  P2  =  {(1,3), 

(2.3) ,  (4,3)}.  Thus,  it  is  only  necessary  to 
check  the  pairs  (1,3)  and  (2,3)  in  order  to  deter¬ 
mine  P2.  Solution  of  the  two  associated  linear 
programs  indicates  that  (1,3)  C  P2  and  (2,3)  t  P2, 
and  hence  P2  =  P,  (1,3)  =  {(1,3),  (4,3)}.  Note 
that  P2  ^  P2.  This  result  is  in  agreement  with  a 
result  found  in  [9],  which  was  determined  from  the 
formulation  and  solution  of  P(P-l)  =  6(6-1)  =  30 
linear  programs. 

The  first  three  objectives  were  linearly 
aggregated  in  Example  3  (8)  with  weights  0.1,  0.1, 
and  0.8,  respectively.  As  a  result,  P2  =  {(1,2), 

(6.3) ,  (6,5)}.  Calculations  show  that  P2  =  {(1,2), 

(1.3) ,  (2,3),  (4,3),  (6,5),  (6,3),  (5,3)}  where  it 
is  noted  that  (1,3)  and  (6,3)  are  members  of  P2  by 
transitivity.  Thus,  the  only  pairs  that  actually 
require  examination  by  the  procedure  suggested  in 
Theorem  1  are:  (1,3),  (2,3),  (6,3),  (5,3).  We 


observe  that  if  (2,3)c  P2  and  (5,3)  t  P2,  then  it 
is  not  necessary  to  check  if  (1,3)  £  P2  and  (6,3) 
c  P2,  respectively,  because  of  the  transitivity  of 
P2-  Solution  of  the  associated  linear  programs 
show  that  (1,3)  and  (6,3)  are  members  of  P2-  We 
have  therefore  determined  that  P2  =  P2  by  formu¬ 
lating  and  solving  only  two  linear  programs.  This 
result  is  in  agreement  with  a  result  found  in  [9], 
which  again  was  determined  from  the  formulation 
and  solution  of  30  linear  programs. 


IV.  CONCLUSIONS 

This  paper  has  investigated  procedures  for 
making  SSD  a  viable  concept  for  interactive  de¬ 
cision  aiding.  Our  primary  contribution  toward 
achieving  this  objective  has  been  the  identifi¬ 
cation  of  a  partial  order  that  acts  as  an  upper 
bound  on  the  SSD  partial  order.  Our  present  level 
of  experience  indicates  that  this  upper  bound,  the 
FSD  partial  order  lower  bound,  the  transitivity  of 
all  three  partial  orders,  and  necessary  and  suffi¬ 
cient  conditions  due  to  Fishburn  and  Vickson  (5) 
can  often  be  used  to  obtain  a  significant  reduc¬ 
tion  in  the  computational  demands  associated  with 
a  straightforward  application  of  our  Theorem  1  in 
determining  P2. 

The  four  step  procedure  for  determining  P2 
proposed  here,  however,  may  not  always  reduce 
computational  time.  Although  straightforward 
application  of  Theorem  1  requires  formulating  and 
computing  at  least  as  many  linear  programs  as 
required  by  the  four  step  procedure j  it  does  not 
require  the  determination  of  Pj ,  P2  or  transi¬ 
tivity  checks.  If  Px  =  ♦  and  P2  =  fl  x  n,  it  is 
clear  that  an  application  of  Theorem  1  that  allows 
for  transitivity  checks  will  be  computationally 
quicker  and  therefore  superior  to  the  four  step 
procedure.  We  have  found,  however,  that  the 
number  of  pairs  in  P2  which  are  not  in  P2  have 
usually  been  a  small  fraction  of  P(P-l)  and  that 
the  time  necessary  to  calculate  P|  and  P2  has 
typically  been  significantly  smaller  than  the  time 
necessary  to  formulate  and  calculate  the  addi¬ 
tional  linear  programs.  Considerable  computa¬ 
tional  experience  to  date  indicates  the  merits  of 
both  approaches  for  calculating  P2. 
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APPENDIX:  Proof  of  Theorem  2. 

It  is  shown  in  [5]  that  R,  and  R2  are  transi¬ 
tive  and  that  R,  £  R2.  A  simple  argument,  based 
on  the  fact  that  the  univariate  SSD  relation  is 
transitive,  proves  that  R2  is  transitive.  In 
order  to  prove  R2  C  R2,  define  Dq  as  the  set  of 

all  {d^}  such  that  (i),  (ii),  and  (iii)  hold  and 

D  as  the  set  of  all  {d . . }  such  that  (iv)'  holds, 
n  ij 

Note  that: 

(a)  jt'R2  n  if  and  only  if 


(b)  n'  R2  n  if  and  only  if 

Dq  fl  Dn  jt  $  for  all  n  =  1 . N. 

Use  of  the  fact  that 


O 


easily  implies  R2  £  R2. 
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Behavioral  and  Organizational  Considerations 
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Abstract — Determinants  of  performance  of  systems  and  processes  (or 
planning  and  decision  support  are  discussed.  This  paper  is  directed  at 
people  who  design  such  systems  and  processes,  who  use  such  systems  and 
processes,  and  who  manage  organizations  in  which  these  may  be  used.  The 
literature  cited  is  associated  with  several  areas  including  psychology, 
organizational  behavior  and  design,  information  science,  management  sci¬ 
ence,  computer  science,  and  related  disciplines.  Performance  determinants 
and  design  requirements  for  systems  and  processes  for  planning  and 
decision  support  are  especially  stressed.  A  number  of  areas  where  addi¬ 
tional  research  appears  needed  are  mentioned,  and  some  recommendations 
and  interpretations  are  given  concerning  both  contemporary  efforts  and 
needed  future  efforts. 

I.  Introduction 

THAT  there  is  much  interest  in  planning  and  decisionmaking 
efforts  to  determine  effective  public  and  private  sector  poli¬ 
cies  is  made  evident  by  the  number  of  recent  texts  and  case 
studies  devoted  to  these  topics  [2],  [4],  [13],  [18],  [20],  [21],  [44], 
[45],  [48].  [51],  [80],  [84]— [86],  [89],  [104],  [105],  [108],  [134],  [135], 
[139],  [141],  [150],  [178],  [179],  [198],  [212],  [219]-[222],  [237], 
[243],  [283],  [293],  [318]-[320].  [334],  [359],  [361],  [363],  [377], 
[394],  [397],  [398],  [400],  [412],  These  in  part,  concern  the  numer¬ 
ous  complexities  associated  with  practical  implementation  of  the 
results  of  systemic  efforts  for  planning  and  decision  support. 
Advances  in  digital  computer  technology  coupled  with  advances 
in  systems  science,  systems  methodology  and  design,  and  systems 
management  suggest  extension  of  the  information  analysis  and 
display  capability  provided  by  management  information  systems 
to  include  interpretation  and  aggregation  of  information  and 
values  such  as  to  result  in  decision  support  systems  (DSS)  or 
planning  and  decision  support  systems.  There  is  a  growing  litera¬ 
ture  in  this  area  [5],  [36],  [39]-[41],  [76],  [86],  [110],  [133],  [138], 
[224],  [226],  [227],  [239],  [240],  [258],  [309],  [350],  [356],  [366]  and 
this  indicates  much  contemporary  interest  and  activity. 

There  are  a  number  of  requirements  for  design  success  with 
respect  to  systems  for  planning  and  dec  sion  support.  These 
involve  a  considerable  number  of  disciplin  :s.  The  result  of  not 
making  appropriate  use  of  pertinent  contribu  ions  from  a  number 
of  disciplines  in  the  design  of  systems  for  planning  and  decision 
support  is  likely  to  be  a  system  or  process  that  is  deficient  in  one 
or  more  important  ways.  The  purpose  of  this  effort  is  to  discuss, 
from  a  systems  engineering  perspective,  some  of  the  many  re¬ 
quirements  for  design  success  in  this  area. 

It  is  possible  to  disaggregate  planning  and  decisionmaking 
processes  into  a  number  of  steps.  In  essence,  they  are  purposeful 
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futuristic  efforts  which  involve  the  entire  systems  engineering 
process  [301 )— [305],  [307],  [308]  and  can.  therefore,  be  described 
by  any  of  a  number  of  frameworks  for  systems  engineering  such 
as  the  three-or  the  seven-step  framework  which  involves; 

1)  Formulation  of  the  issue. 

a)  problem  definition  (determination  of  needs,  constraints, 
alterables) 

b)  value  system  design  (determination  of  objectives  and 
objectives  measures) 

c)  system  synthesis  (identification  of  possible  decisions  or 
action  alternatives  and  measures  of  the  accomplishment 
of  these); 

2)  Analysis  of  the  issue. 

d)  systems  analysis  and  modeling  (determination  of  the 
structure  of  the  decision  situation,  the  impacts  of  identi¬ 
fied  decisions  or  action  alternatives  and  the  sensitivity  of 
these  to  possible  change  in  conditions) 

e)  optimization  or  refinement  of  alternatives  (adjustment  of 
parameters  or  activities  such  that  each  identified  decision 
is  the  best  possible  in  accordance  with  the  value  system); 

3)  Interpretation  of  the  issue 

f)  evaluation  and  decisionmaking  (each  possible  decision 
alternative  is  evaluated,  prioritized,  and  one  or  more 
alternatives  are  selected  for  implementation  action) 

g)  planning  for  action  (commitment  of  resources  are  made 
and  implementation  is  accomplished). 

Janis  and  Mann  [177]  have  identified  a  four-stage  model  of  the 
decisionmaking  process.  Fig.  1  presents  a  slightly  modified  ver¬ 
sion  of  this  decision  process  model.  We  note  that  it  contains  the 
same  essential  steps  involved  in  the  systems  engineering  process. 
Of  particular  interest  are  the  questions  asked  at  each  step  of  the 
process.  We  will  elaborate  upon  this  model  and  other  models  of 
the  decisionmaking  process  in  our  efforts  to  follow. 

Comprehensive  efforts  involving  decisionmaking  will  be  com¬ 
plex  because  of  the  many  disciplines  and  areas  involved  as  well  as 
because  of  the  subject  matter  itself.  Probably  the  formal  study  of 
decisionmaking  first  began  with  the  rational  economic  man  con¬ 
cepts  of  the  18th  century  mathematicians  Cramer  and  Bernoulli 
who  explained  the  St.  Petersburg  paradox.  Since  then  there  have 
been  many  workers  from  a  large  number  of  disciplines  who  have 
been  concerned  with  various  types  of  decisionmaking  studies  and 
the  provision  of  assistance  to  enhance  the  understanding  of 
rationale  for  plans  and  decisions  as  well  as  improvements  in  the 
efficiency,  effectiveness,  and  equity  of  the  resource  allocations 
that  constitute  planning  and  decisionmaking. 

Contemporary  choicemaking  issues  in  the  public  and  private 
sector  are  complex,  contain  much  uncertainty,  and  require  inputs 
from  many  sectors  for  full  understanding  and  resolution.  Many 
writers  have  indicated  bounded  rationality  limits  in  decisionmak¬ 
ing  that  would  appear  to  make  provision  of  information  system 
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Fig.  I .  Systems  engineering  interpretation  of  the  decision  process  model  of  Jams  and  Mann. 


adjuvants  for  choicemaking  normatively  very  desirable.  Such 
planning  and  decision  support  systems  could,  in  principle,  pro¬ 
vide  decisionmakers  with  rapid  access  to  the  information  and 
knowledge  needed  to  enhance  decision  quality.  Unfortunately 
this  promise  of  enhanced  decision  quality  has  not  always  been 
realized  in  practice.  There  are,  doubtlessly,  a  number  of  causitive 
factors  inhibiting  the  potential  benefits  possible  from  information 
systems  for  planning  and  decision  support.  Principal  among  these 
factor  which,  at  present,  pose  fundamental  limits  to  information 
system  success  appear  to  be 

1)  the  need  to  insure  substantive  or  input-output  rationality, 
such  that  evaluations  of  plans  and  decisions  are  veridical: 

2)  the  need  to  insure  process  rationality,  such  that  the  infor¬ 
mation  system  accommodates  the  capabilities  of,  and  the 
constraints  placed  upon,  the  user; 

3)  the  need  to  understand  and  cope  with  human  cognitive 
limitations  as  they  affect  the  formulation,  analysis,  and 
interpretation  of  decision  situations  and  alternatives;  and 

4)  the  need  to  understand  and  integrate  the  normative  or 
prescriptive  components  with  the  descriptive  components  of 
decision  situations  in  order  to  evolve  realistic  adjuvants  for 
the  formulation,  analysis,  and  interpretation  of  decision 
options. 


This  paper  presents  a  survey,  status  report,  and  integration  and 
interpretation  of  research  from  a  diversity  of  areas  that  supports 
the  design  of  information  systems  capable  of  coping  with  the 
needs  and  fundamental  limits  to  improved  judgment.  We  discuss 
and  describe 

1)  the  cognitive  styles  of  decisionmakers; 

2)  individual  human  information  processing  in  decision  situa¬ 
tions  and  biases  in  the  acquisition,  analysis,  and  interpreta¬ 
tion  of  information; 

3)  decision  rules  for  individual  decision  situations; 

4)  contingency  task  structural  models  of  decision  situations: 
and 

5)  decisionmaking  frameworks,  organizational  settings,  and  in¬ 
formation  processing  in  group  and  organizational  decision 
situations. 

In  a  very  real  sense  the  structural  models  section.  Section  V,  is 
the  principal  portion  of  this  effort.  It  contains  the  basic  de¬ 
cisionmaking  paradigm,  including  action  selection.  The  con¬ 
tingency  task  structure,  which  comprises  the  issue  at  hand,  the 
environment  into  which  the  issue  is  imbedded,  the  decisionmaker, 
and  decisionmaker  experiential  familiarity  with  the  issue  and 
environment,  is  the  determinant  of  cognitive  style  and  perfor- 
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mance  objectives  for  the  particular  task  at  hand.  These,  in  turn, 
influence  selection  of  an  information  processing  approach  and 
selection  of  a  decision  rule. 

The  literature  in  this  area  is  enormous.  But  there  is  the  need 
for  efforts  to  integrate  it  from  the  perspective  of  systems  en¬ 
gineering  design  of  information  systems  for  planning  and  deci¬ 
sion  support.  There  are  a  number  of  recent  surveys  available  that 
discuss  one  or  a  limited  number  of  the  topics  important  for  the 
design  of  planning  and  decision  support  systems.  These  include 
the  surveys  of  Barron  [27],  Benbasat  and  Taylor  [35],  Bettman 
[37],  Craik  [67],  Dunnette  [87],  Einhom,  Kleinmuntz,  and 
Kleinmuntz  [95];  Einhom  and  Hogarth  [98],  Ericsson  and  Simon 
[99],  Hammond,  McClelland,  and  Mumpower  [142];  Hammond 
[143],  Hogarth  [159],  Hogarth  and  Makridakis  [161],  Johnson  and 
Huber  [179],  Kassin  [190],  Keen  [193],  Libby  and  Fishbum  [214], 
Libby  and  Lewis  [215],  Mintzberg  [248],  Nisbett  and  Ross 
[264],  Nutt  [266],  Robey  and  Taggart  [292],  Sage  and  White  [304], 
Schneider  and  Shiffrin  [313],  Slovic  and  Lichtenstein  [345],  Slovic, 
Fishhoff,  and  Lichtenstein  [348];  Svenson  [365],  and  Zmud  [415]. 
This  work  attempts  a  selective  integration  of  this  voluminous 
literature  and  extensions  and  interpretations  of  it  from  the  per¬ 
spective  of  ultimate  potential  usefulness  for  the  design  of  infor¬ 
mation  systems  for  planning  and  decision  support.  Generally, 
references  are  provided  only  to  published  literature  of  the  last 
half  decade  with  limited  references  to  earlier  seminal  literature 
and  reports.  This  was  felt  desirable  in  order  to  limit  the  reference 
list  to  an  almost  manageable  size.  Despite  our  attempt  to  make 
this  report  comprehensive,  it  doubtlessly  fails  to  incorporate  the 
important  contributions  of  a  number  of  authors.  And  there  are 
doubtlessly  unintentional  misattributions  and  misinterpretations 
as  well.  For  this  apologies  are  offered  and  forgiveness  requested. 

II.  Cognitive  Styles 

It  is  becoming  increasingly  clear  that  it  is  necessary  to  incorpo¬ 
rate  not  only  problem  characteristics,  but  also  problem  solver  or 
decisionmaker  characteristics,  into  the  design  of  information  sys¬ 
tems  for  planning  and  decision  support.  A  deficiency  in  some 
past  designs  has  been  the  neglect  of  the  human  decisionmakers’ 
role  and  characteristics  and  their  effects.  Essentially  all  available 
evidence  suggests  that  problem  characteristics  and  user  character¬ 
istics  influence  the  planning  and  choice  strategies  adopted  by  the 
decisionmaker.  This  section  discusses  a  number  of  cognitive  style 
models  from  these  perspectives. 

Mason  and  Mitroff  [238]  have  suggested  that  each  person 
possesses  a  particular  specific  psychological  cognitive  style  or 
“personality"  and  that  each  personality  type  utilizes  information 
in  different  ways.  In  their  research  on  (MIS)  management  infor¬ 
mation  system  design,  they  claim  that  an  information  system 
consists  of  a  person  of  a  certain  psychological  type  who  faces  a 
problem  in  some  organizational  context  for  which  needed  evi¬ 
dence  to  arrive  at  a  solution  is  made  available  through  some 
mode  of  presentation. 

There  are  five  essential  variables  in  the  information  system 
characterization  of  Mason  and  Mitroff.  Each  of  these  are  disag¬ 
gregated  into  subelements.  Mason  and  Mitroff  characterize  the 
psychological-type  variable  according  to  the  Jungian  stereotvpol- 
ogy.  In  this  typology,  people  differ  according  to  their  preference 
for  information  acquisition  and  analysis  and  the  preferred  ap¬ 
proach  to  information  evaluation  and  interpretation.  At  extremes 
in  the  information  acquisition  dimension  arc  sensing-oriented  or 
sensation  tvpes  who  prefer  detailed  well-structured  problems  and 
who  like  precise  routine  tasks,  and  intuitive-onented  type  people, 
who  dislike  precise  routine  structured  tasks  and  perceive  is¬ 
sues  wholisticallv.  At  extremes  in  the  information  evaluation 
dimension  are  feeling-oriented  people,  who  rely  on  emotions, 
situational  ethics,  and  personal  values  in  making  decisions;  and 
thinking-oriented  individuals,  who  rely  on  impersonal  logical 
arguments  in  reaching  decisions. 


Mason  and  Mitroff  characterize  the  problem  variable  into 
structured  and  unstructured  problems.  These  may  be  further 
divided  into  decisions  under  certainty,  decisions  under  risk,  and 
decisions  under  uncertainty.  The  organizational  context  variable  is 
characterized  as  strategic  planning,  management  control,  and 
operational  control.  The  method-of-evidence-generation  variable 
involves  five  types  of  inquiry  systems:  the  data-based  Lockean 
inquiry  system,  the  model-based  Leibnitzian  inquiry  system,  the 
multiple  model-based  Kantian  inquiry  system,  the  conflicting 
model-based  Hegelian  inquiry  system,  and  the  learning  system 
based  Singerian-Churchmanian  inquiry  system  [254],  A  fifth 
variable,  mode  of  presentation ,  includes  personalistic  modes  of 
presentation  such  as  one-on-one  contact  as  in  drama  and  art  and 
impersonalistic  modes  such  as  abstract  analytical  models  and 
company  reports.  These  latter  four  variables  do  not  formally 
relate  to  cognitive  styles,  and  some  further  comment  on  them  is 
contained  in  other  portions  of  our  effort.  A  number  of  works  by 
Mason  and  Mitroff  and  their  colleagues  discuss  various  aspects 
of  this  categorization  [252]— [254],  Of  interest  in  this  regard  is  a 
work  by  Kilmar  i  [200]  which  suggests  the  design  of  organiza¬ 
tions  with  the  Jungian  personality  characteristics  of  individuals. 

Among  the  many  other  studies  which  have  emphasized  the 
need  to  incorporate  decisionmaker  characteristics  into  informa¬ 
tion  system  design  is  that  of  Doktor  and  Hamilton  [78],  They 
studied  the  influence  of  cognitive  style  on  the  acceptance  of 
management  science  recommendations  and  found  a  strong  corre¬ 
lation  between  the  decisionmaker’s  cognitive  style  and  willingness 
to  accept  these  recommendations.  They  found  that  differences  in 
acceptance  rates  were  due  not  only  to  differences  in  cognitive 
style  but  also  to  differences  in  this  subject  population.  From  this 
and  many  other  investigations  [34],  [74],  [77],  [79],  [101],  [151], 
[166],  [174],  [229],  [252],  [253],  [263],  [267],  [268],  [311],  [330], 
[369],  it  appears  that  appropriate  consideration  of  the  human 
behavioral  variable  of  cognitive  style  is  very  necessary  for  suc¬ 
cessful  design  of  decision  support  systems. 

A  number  of  studies  such  as  those  by  Taylor  [369],  Craik  [67], 
Payne  [272],  Schneider  and  Shiffrin  [313],  [327]  and  Simon  [342], 
indicate,  as  we  will  discuss  in  later  sections,  that  human  de¬ 
cisionmakers  attempt  to  bring  order  into  their  information 
processing  activities  when  confronted  with  excess  information  or 
the  lack  of  sufficient  information.  Many  early  studies  assumed 
that  static  fixed  patterns  of  dealing  with  information  were  “pre¬ 
ferred”  by  the  decisionmaker  for  the  process  of  experiencing  the 
world,  and  these  were  referred  to  as  “cognitive  style.”  Some  early 
studies  view  cognitive  style  as  a  mode  of  functioning  that  is  static 
and  pervasive  throughout  a  person’s  perceptive  and  intellectual 
activities.  A  number  of  intellectual  processes  are  subsumed  within 
the  term  cognitive  style.  These  concern  the  way  in  which  informa¬ 
tion  is  acquired  or  formulated,  analyzed,  and  interpreted.  Thus, 
cognitive  style  includes  such  human  activities  as  information 
filtering  and  pattern  recognition. 

Zmud  has  indicated  [414],  [415]  that  those  individual  dif¬ 
ferences  which  influence  information  system  success  most  strongly 
involve  cognitive  style,  personality,  and  demographic /situational 
variables.  Cognitive  style  refers  to  the  process  behavior  that 
individuals  exhibit  in  the  formulation  or  acquisition,  analysis, 
and  interpretation  of  information  or  data  of  presumed  value  for 
decisionmaking.  Doubtlessly  cognitive  style  is  somewhat  in¬ 
fluenced  by  such  personality  variables  as  dogmatism,  introver¬ 
sion,  extroversion,  and  tolerance  for  ambiguitv.  However,  little 
appears  known  concerning  these  influences.  Gough  discusses 
personality  and  personality  assessment  in  his  chapter  (87);  but  it 
is  rare  to  find,  with  some  notable  exceptions  |249|-(25ll.  [330], 
[332],  [352],  discussions  of  personality  effects  upon  decisionmak¬ 
ing  behavior  in  cognition  studies.  The  demographic/  situational 
variables  involve  personal  characteristics  such  as  intellectual  abil¬ 
ity,  education,  experience  with  and  knowledge  of  specific  con¬ 
tingency  tasks,  age,  and  the  like.  An  important  situational  vari¬ 
able  is  the  level  of  stress  encountered  by  the  decisionmaker  in  a 
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specific  problem  situation.  The  level  of  stress,  which  results  in  the 
adoption  of  a  coping  pattern,  influences  the  decisionmaker's 
ability  in  acquisition  and  processing  of  the  information  necessary 
for  decisionmaking.  The  subject  of  stress  will  be  dealt  with  in 
some  detail  in  Section  V.  Many  variables  are  especially  important 
for  an  information  processing  model  of  cognitive  behavior.  Some 
will  be  discussed  in  Section  III.  Our  efforts  in  this  section  will  be 
devoted  primarily,  therefore,  to  cognitive  style  concepts,  espe¬ 
cially  the  role  of  personality  variables  in  the  adoption  of  cogni¬ 
tive  style. 

There  are  a  number  of  cognitive  style  models  in  addition  to 
that  of  Mason  and  Mitroff.  Bariff  and  Lusk  [24),  for  example, 
have  discussed  three  cognitive  style  characteristics  relevant  to 
information  system  design:  cognitive  complexity,  field  depen¬ 
dent/independent.  and  systematic/heuristic.  The  cognitive  com¬ 
plexity  characteristic  involves  three  structural  characteristics  of 
thinking  and  perception:  differentiation,  the  number  of  dimen¬ 
sions  sought  or  extracted  and  assimilated  from  data  discrimina¬ 
tion;  the  fineness  of  the  articulation  process  in  which  stimuli  are 
assigned  to  the  same  or  different  categories:  and  integration,  the 
number  and  completeness  of  interconnections  among  rules  for 
combining  information. 

Benbasat  and  Taylor  [35]  note  that  much  cognitive  complexity 
research  deais  with  interpersonal  perception  and  has  limited 
value  for  modeling  activities  of  managers  in  processing  informa¬ 
tion  and  making  decisions.  Mischel  is  especially  perceptive  in 
discussing  the  potential  hazards  of  attributions  and  enduring 
categorizations  of  people  into  fixed  slots  on  the  basis  of  a  few 
behavioral  signs  in  his  study  of  the  interface  between  cognition 
and  personality  [251],  The  assumptions  that  static  characteriza¬ 
tions  are  sufficiently  informative  to  enable  behavior  predictions 
in  specific  settings  are  strongly  challenged.  An  evaluation  of  the 
uses  and  limitations  of  static  trait  characterization  of  individuals 
is  presented  and  the  strong  interacting  role  of  context  is  em¬ 
phasized.  Mischel  is  especially  concerned  with  “cognitive  eco¬ 
nomics,”  that  is  to  say  the  recognition  that  people  are  easily 
overloaded  with  an  abundance  of  information  and  that  simplified 
methods  of  acquisition  and  processing  of  information  are,  there¬ 
fore.  used.  He  is  especially  concerned  also  with  grcw'h  of  self- 
knowledge  and  rules  for  self-regulation  with  maturation,  topics  to 
be  discussed  in  Section  V.  We  concur  with  these  views  in  that  we 
believe  that  it  is  the  individual’s  experience  with  the  task  at  hand 
that  is  the  primary  determinant  of  cognitive  style.  Further  we 
believe  that  it  is  an  individual’s  information  processing  capacity 
under  various  levels  of  stress  and  in  different  contingency  task 
structures  that  determines,  in  part,  the  quality  of  decisionmaking. 
These  factors  depend  strongly  upon  experience.  Thus  we  support 
the  information  processing  view  of  Simon  [337]— [344]  that  few 
characteristics  of  the  human  information  processing  system  are 
invariant  over  the  decisionmaker  and  the  task.  These  characteris¬ 
tics  are  generally  experiential  and  evolve  over  time  in  a  dynamic 
fashion.  They  are  not  static  and  can  not  be  treated  as  static  and 
task  invariant  for  a  given  individual. 

In  the  Bariff  and  Lusk  cognitive  style  model  [24],  individuals 
may  be  categorized  according  to  whether  they  are  tightly  bound 
by  external  referrents  in  structuring  cognitions,  in  which  case 
they  are  called  field  dependent  or  low  analytic;  or  whether  they 
can  make  use  of  internal  referrents  as  well  as  external  referrents 
in  structuring  cognitions,  in  which  case  they  arc  high  analytic  or 
field  independent.  In  a  field-dependent  mode,  perception  is 
dominated  by  the  overall  organization  of  the  field.  There  is 
limited  abilitv  to  perceive  discrete  parts  of  a  field,  especially  as 
distinct  from  a  specific  organized  background.  Field  independent 
people  have  more  analytical  and  structuring  abilities  in  compari¬ 
son  to  field  dependent  people  in  that  they  can  disaggregate  a 
whole  into  its  component  parts. 

The  svstcmatic-hcuristic  categorization  of  Bariff  and  Lusk 
describes  cognitive  styles  associated  with  people  who  either  search 
information  for  causal  relationships  that  promote  algorithmic- 


solutions,  or  who  search  information  by  trial  and  error  hypothesis 
testing.  Systematic  individuals  utilize  abstract  logical  models  and 
processes  in  their  cognition  efforts.  Heuristic  individuals  utilize 
common  sense,  past  experience,  and  intuitive  “feel."  Systematic 
individuals  would  be  able  to  cope  with  well-structured  problems 
without  difficulty  and  would  approach  unstructured  problems  by 
attempting  to  seek  underlying  structural  relations;  whereas  heur¬ 
istic  individuals  would  attempt  to  cope  with  unstructured  prob¬ 
lems  without  a  conscious  effort  to  seek  structural  identification. 

Of  particular  importance  with  respect  to  cognitive  styles  are 
relationships  between  the  environmental  complexity  of  the  con¬ 
tingency  task  structure  and  information  processing  characteris¬ 
tics.  A  number  of  authors  have  attempted  experiments  based  on 
the  hypothesis  that  the  conceptual  structure  of  the  individual 
determines  information  processing  characteristics.  Conceptual 
structure  is  typically  measured  on  a  dimension  of  abstract  versus 
concrete.  Abstract  individuals  would  be  capable  of  using  integra- 
tively  more  complex  conceptual  processes  than  concrete  type 
individuals.  Abstractness  may  be  characterized  by  the  ability  to 
differentiate  a  greater  variety  of  information  and  to  discriminate 
and  integrate  information  in  complex  ways.  Abstract  individuals 
would,  therefore,  be  expected  to  base  actions  on  more  informa¬ 
tion  and  to  develop  more  complex  strategies  for  information 
evaluation  than  concrete  individuals.  This  is  somewhat  similar  to 
Piaget’s  account  of  evolving  cognitive  development.1  in  that  the 
“formal”  thinker  is  capable  of  abstract  thought  whereas  the 
“concrete"  thinker  relies  more  on  preceptual  experience  as  a  basis 
for  thought  and  problem  solution.  While  the  work  of  Piaget 
appears  to  assume  that  cognitive  capacity  evolves  over  time,  some 
research  involving  personality  and  cognitive  style  assumes  that  an 
individual's  cognitive  style  is  not  task  dependent  and  not  subject 
to  change  as  a  function  of  contingency  variables  such  as  experi¬ 
ence. 

Among  other  efforts.  Driver  and  Mock  [83]  developed  deci¬ 
sion-style  theory,  a  set  of  four  decision  styles  based  upon  the 
heuristic- analytic  characterization  of  Huysman  [172]  to  relate 
conceptual  structure  of  decisionmakers  to  both  the  amount  of 
information  they  tend  to  use  and  the  degree  of  focusing  that  they 
exhibit  in  the  use  of  information.  A  heuristic  person  will  use 
intuition,  past  experience,  concrete  thought,  and  a  wholistic  ap¬ 
proach  to  reach  decisions.  An  analytic  person  will  utilize  abstract 
logical  models  and  will  search  for  causal  relationships  and  un 
derlying  structure  to  evolve  rationale  for  decisionmaking.  The 
four  decision  styles  are  determined  by  the  degree  of  focus  in  the 
use  of  information  and  the  amount  of  information  desired.  A 
decisive  person  is  one  who  wishes  to  see  the  minimum  possible 
amount  of  information  and  who  will  likely  identify  a  single 
workable  decision.  Decision  speed  obtained  from  short  summary, 
often  verbal  reports,  is  a  characteristic  of  the  decisive  person.  A 
flexible  person  is  one  who  utilizes  minimum  information  but  who 
will  identify  a  number  of  potentially  acceptable  decisions.  A 
hierarchic  person  is  one  who  utilizes  much  information,  often 
obtained  in  a  thorough  way  from  long  involved  precise  reports  to 
identify  a  single  acceptable  decision.  An  integrative  person  utilizes 
much  information  to  identify  a  number  of  potentially  acceptable 
decisions. 

Vasarhelyi  [389]  has  also  examined  the  analytic-heuristic  di¬ 
mension  His  experimental  results  indicate  generally  that  analytic 
type  people  tend  to  use  computers  and  other  analytic  tools  more 
in  planning  than  do  heuristic  types.  Heuristic  types  use  less 
information  than  the  analytic  types  and  arc  more  concerned  with 
the  lack  of  flexibility  in  computers  than  analytic  types.  However, 
his  study  of  correlations  among  various  style-measuring  inst.u- 
ments  indicates  that  these  are  relatively  low. 

Driver  and  Mock  also  suggested  a  fifth  style  which  thev 
referred  to  as  the  complex  style,  which  is  characterized  by  a  wide 
search  and  analysis  of  information.  It  is  a  mixture  of  the  integra- 
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live  and  hierarchic  types.  Zmud  [415]  has  performed  some  experi¬ 
mental  studies  of  this  decision  style  theory.  His  findings  indicate 
that  perceptual  differences  can  indeed  be  observed  for  specific 
cognitive  styles  and  among  subjects  with  different  educational 
and  experiential  backgrounds.  However,  his  results  also  indicate 
that  there  is  no  apparent  relationship  between  cognitive  style 
perceptions  and  actual  cognitive  behavior  despite  consistent  dif¬ 
ferences  in  perceptions  of  cognitive  styles. 

McKenney  and  Keen  [242]  have  done  extensive  work  on 
cognitive  style  measurements.  These  have  become,  in  part,  the 
basis  for  several  definitive  efforts  [192],  [193],  [258]  in  decision 
support  system  design.  They  conceptualize  cognitive  style  in  two 
dimensions:  information  acquisition  and  information  processing 
and  evaluation.  The  information  acquisition  mode  consists  of 
receptive  and  preceptive  behavior,  both  at  the  opposite  extremes 
of  a  continuum.  They  claim  that  preceptive  decisionmakers  use 
concepts,  or  precepts,  to  filter  data,  to  focus  on  patterns  of 
information,  and  to  look  for  deviations  from  or  conformities  with 
their  expeditions.  Receptive  people  tend  to  focus  on  detail  rather 
than  patterns  and  derive  implications  from  data  by  direct  ob¬ 
servation  of  it,  rather  than  by  fitting  it  to  their  own  precepts. 

With  respect  to  information  processing  and  evaluation, 
McKenney  and  Keen  measured  individuals  on  a  scale,  with  the 
systematic  thinker  at  one  extreme  and  the  intuitive  thinker  at  the 
other  extreme.  They  have  shown,  using  a  battery  of  pencil  and 
paper  tests,  that  systematic  thinkers  approach  a  problem  by 
structuring  it  in  terms  of  some  method  which  would  lead  to  a 
solution,  whereas  intuitive  thinkers  use  trial  and  error,  intuition, 
and  previous  experience  to  obtain  solutions. 

We  have  examined  four  cognitive  style  characterizations  in  this 
section.  Table  1  summarizes  the  models  of  cognitive  style  that 
result  from  these  efforts.  We  note  the  considerable  similarity 
among  these  four  constructs.  There  have  been  a  number  of 
studies  of  the  measuring  instruments  involved  in  classifying  peo¬ 
ple  according  to  these  cognitive  styles.  Many,  such  as  the  study 
by  Vasarhelyi  [389]  mentioned  previously,  have  found  rather  low 
correlations  among  test  instruments.  Zmud  [413],  [415]  has  indi¬ 
cated  low  correlation  also  among  test  scores  on  different  instru¬ 
ments  indicating  cognitive  styles.  Chervanv.  Scnn,  and  Dickson 
[57).  [76]  have  expressed  much  concern  and  pessimism  concerning 
the  validity  of  much  of  the  contemporary  research  in  this  area. 
They  comment  that  the  study  of  individual  personality  dif¬ 
ferences  as  predictors  of  human  behavior  and  performance  have 
been  basically  unsuccessful  in  that  it  has  not  been  possible  to 
predict  performance  on  the  basis  of  personality  characteristics. 
Their  comment  and  the  comment  of  others  that  the  characteris¬ 
tics  of  the  task  in  which  the  individual  involved  is  a  prime 
determinant  of  human  behavior,  appears  unassailable.  We  will 
provide  and  discuss  additional  evidence  supporting  a  dynamic 


cognitive  style  characterization  that  will  incorporate  the  con¬ 
tingency  task  structure  and  the  decisionmaker’s  task  experience 
in  several  other  sections  of  this  paper.  In  particular  we  emphasize 
the  strong  need  for  consideration  of  the  structure  and  the  content 
of  planning  and  decision  situations  in  order  to  evolve  contextu¬ 
ally  meaningful  support. 

III.  Information  Processing 

Problem  solving,  judgment,  and  decisionmaking  imply  both 
thought  and  action.  Hence  decisionmaking  can  be  defined  as  the 
processes  of  thought  and  action  involving  an  irrevocable  alloca¬ 
tion  of  resources  that  culminates  in  choice  behavior.  In  making  a 
decision,  more  often  than  not,  the  decisionmaker  is  dealing  with 
environments  characterized  by  risks,  hazards,  uncertainty,  com¬ 
plexity,  changes  over  time,  and  conflict.  Further,  the  quality  of  a 
decision  depends  upon  how  well  the  decisionmaker  is  able  to 
acquire  information,  to  analyze  information,  and  to  evaluate  and 
interpret  information  such  as  to  discriminate  between  relevant 
and  irrelevant  bits  of  data.  Decision  quality  also  depends  upon 
how  well  the  decisionmaker  is  able  to  cope  with  stress,  which  is 
invariably  encountered  in  important  decision  circumstances.  Ef¬ 
fective  management  of  these  factors  enables  strategies  by  which 
the  decisionmaker  may  arrive  at  a  good  problem  solution,  deci¬ 
sion,  or  judgment. 

A  number  of  studies  such  as  those  by  Barron  [28],  Bettman 
[37],  Chorba  and  New  [58],  Delaney  and  Wallsten  [73],  Feather 
[107],  Howell  and  Fleishman  [165],  O.  Huber,  [168],  G.  Huber 
[170],  [171];  Ives,  Hamilton,  and  Davis  [174];  Libby  and  Lewis 
[215],  Lucas  and  Nielson  [228],  MacCrimmon  and  Taylor  [232], 
Montgomery  and  Svenson  [256],  Moskowitz,  Schaefer,  and 
Borcherding  [259];  Payne  [275],  Simon  [342],  Tushman  and 
Nadlcr  [379],  Tuggle  and  Gerwin  [380],  Wallsten  [395],  [396];  and 
Wright  [402]— [406]  discuss  the  vital  role  of  human  information 
processing  in  decisionmaking.  Most  contemporary  researchers 
regard  information  processing  as  a  crucial  task  for  effective 
decisionmaking  and  state  that  the  type  of  decision  problem,  the 
nature  of  the  decision  environment,  and  the  current  state  of  the 
decisionmaker  combine  to  determine  decision  style  and  decision 
strategy  for  a  specific  task.  The  term  information  processing 
refers  to  the  processing  of  verbal  reports  as  well  as  quantitative 
data  since  verbal  reports  are  data  [99], 

An  information  processing  theory  of  problem  solving,  judg¬ 
ment.  and  decisionmaking  is  based  on  the  assumption  that  indi¬ 
viduals  have  an  input  mechanism  for  acquisition  of  information, 
an  output  mechanism  for  interpretation  and  choicemaking,  inter¬ 
nal  processes  for  filtering  and  other  analysis  efforts  associated 
with  information,  and  memories  for  long-  and  short-term  storage 
of  information.  There  are  a  large  number  of  ways  of  representing 
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Fig.  2.  A  systems  engineering  conceptual  model  of  human  information  processing. 


human  information  processing.  Many  of  these  are  described  in 
texts  in  cognitive  psychology  such  as  Anderson  [7],  Posner  [281], 
or  Solso  [354],  and  in  works  in  consumer  choice  such  as  Bettman 
[37],  Much  of  the  work  in  this  area  owes  a  great  deal  to  Simon 
[334]— [344]  who  has  developed  information  processing  theories  in 
psychology  and  in  artificial  intelligence. 

Fig.  2  presents  a  conceptual  model  of  a  systems  engineering 
framework  [308]  for  human  information  processing.  There  are 
doubtlessly  a  number  of  components  missing  from  this  model.  It 
does  not  show,  for  example,  the  essentially  iterative  nature  of  the 
process.  Nevertheless  we  feel  that  it  provides  a  useful  point  of 
departure  and  a  structure  for  our  efforts  to  follow. 

The  key  functions,  which  determine  how  a  specific  problem  or 
decision  situation  is  cognized,  depend  upon  an  interaction  of  the 
memory  and  higher-order  cognition  of  the  problem  solver  with 
the  environment  through  the  contingency  task  structure.  We  will 
be  very  concerned  with  development  of  a  conceptual  model  of 
higher-order  cognition  and  the  contingency  task  structure  in 
Section  V.  It  is  appropriate  to  remark  here  that  the  various 
information  analysis  and  interpretation  processes  of  thinking, 
task  performance  objective  identification,  evaluation,  and  deci¬ 
sion  rule  identification,  are  called  “higher  order”  cognition.  This 
is  not  because  they  are  somehow  more  important  than  the  so 
called  “lower  order”  cognition  efforts  of  information  acquisition 
involving  formulation:  sensation,  attention,  perception,  and  pat¬ 
tern  recognition:  but  because  they  occur  later  in  time  in  the 
overall  information  processing  effort. 

It  is  important  to  note  that  information  processing  and  de¬ 
cisionmaking  efforts  intimately  involve  memory.  Memory  [102] 
influences  human  judgment  in  a  number  of  ways.  It  will  influence 
the  perception  of  the  contingency  task  structure  associated  with 
an  issue  as  well  as  the  decision  rules  used  for  evaluation  of 
alternatives.  Two  characteristics  of  human  memory  are  of  special 
importance  for  our  efforts  here.  First,  information  will  be  en¬ 
coded  in  more  or  less  efficient  and  effective  ways  in  terms  of 
human  abilities  for  recall.  The  coding  process  is  dependent,  also, 
upon  the  interpretation  attached  to  information  and  this  strongly 
influences  event  recall,  perceptions,  and  associated  cognitive  bi¬ 
ases.  The  literature  concerned  with  memory  and  its  components, 
and  their  relations  and  interaction  with  human  perceptual  experi¬ 
ence  and  behavior  is  vast  and  speculative  in  nature.  There  have 
been  manv  studies,  both  physiological  and  psychological,  con¬ 
cerned  vith  th'  identification  of  the  memory  “engram,"  which  is 
hypothesized  be  the  fundamental  unit  of  memory.  We  need 
not  be  ^zcially  concerned  in  this  effort  with  the  various  physio¬ 
logical  structures  and  processes  associated  with  human  memory; 


or  with  various  related  behavior  therapies  [109];  however  the 
essentials  are  reviewed  below  briefly.  A  useful  brief  survey  of  the 
literature  on  memory  is  presented  by  Thomassen  and  Kempen  in 
chapter  3,  vol.  II  [244],  by  Fox  [128],  and  by  Radcliff  [284], 

Human  memory  constitutes  two  major  components,  short-term 
memory  and  long-term  memory.  Short-term  memory  plays  a  key 
role  in  immediate  recall  of  actively  rehearsed  limited  information 
[7],  [354],  Unless  conscious  effort  is  put  forth  in  recalling  infor¬ 
mation  from  short-term  memory,  this  cannot  be  done  after  a 
lapse  of  30  to  60  s  from  initial  presentation.  Models  of  a  working 
short-term  memory  involve  a  number  of  mechanisms,  such  as  an 
articulatory  rehearsal  loop  that  has  the  capacity  to  retain  short 
verbal  sequences.  This  is  just  one  mechanism  by  which  short-term 
retention  is  possible.  There  are  a  number  of  other  sensory  reg¬ 
isters.  It  is  important  to  note  that  short-term  memory  is  an 
integrated  network  of  many  mechanisms,  and  is  associated,  in 
use,  with  a  number  of  skilled  processes. 

Shiffrin  and  Schneider  [313],  [327]  incorporate  concepts  of 
attention,  memory,  and  perceptual  learning  in  their  theory  of 
short-term  retention.  They  hypothesize  short-term  storage,  the 
function  of  which  is  active  control  of  thinking,  reasoning,  and 
general  memory  processes.  According  to  Shiffrin  &  Schneider, 
short-term  storage  is  an  activated  subset  of  long-term  storage. 
Transfer  of  information  from  short-term  storage  to  long-term 
storage  is  dependent  on  attentional  limitations,  interference  from 
strong  external  and  internal  stimuli,  extent  of  analysis  of  infor¬ 
mation,  and  formation  of  associations  in  long-term  storage.  There 
have  been  many  studies  involving  concepts  such  as  retrieval 
processes,  memory  trace  identification,  encoding  processes,  and 
recognition  which  we  will  not  discuss  as  they  appear  of  secondary 
importance  to  the  goals  of  this  particular  effort.  While  five  to 
seven  unconnected  items  is  believed  to  be  the  maximum  amount 
of  information  that  can  be  retained  in  short-term  memory,  long¬ 
term  memory  may  contain  a  virtually  limitless  amount  of  infor¬ 
mation. 

Thus  we  see  an  enormous  difference  between  human  abilities 
and  computer  abilities.  Because  of  its  large  long-term  memory 
and  ability  for  quick  search  and  recall,  a  human  mind  easily 
reasons  wholisticallv.  Wholistic  reasoning,  such  as  reasoning  by 
analogy,  is  not  at  all  easy,  at  this  time  at  least,  for  a  computer. 
Significant  unaided  computational  effort  would  be  difficult  for  a 
human  since  computation  must  be  done  in  short-term  memory. 
There  exists  the  possibility  that  information  stored  in  long-term 
memory  is  flawed  because  of  cognitive-biases  introduced  bv 
processing  in  short-term  memory.  A  principal  task  of  computer- 
aided  support  must  be  to  augment  human  capabilities  in  need  of 
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augmentation,  while  not  diminishing  abilities  in  those  areas  in 
which  human  abilities  exceed  those  of  the  computer  [81]. 

Our  effort  in  the  remainder  of  this  section  will  be  devoted  to  a 
description  of  the  various  processes  which  support  information 
acquisition  and  information  analysis.  We  will  also  discuss  some 
of  the  cognitive  biases  that  can  result  from  “poor”  information 
acquisition  and  information  analysis.  Information  interpretation, 
which  leads  to  alternative  evaluation  and  decisionmaking,  is  an 
important  and  somewhat  distinct  part  of  the  overall  information 
processing  model.  It  will  be  discussed  in  the  next  four  sections 
from  several  perspectives. 

The  types  of  operations  involved  in  information  acquisition  are 
sensation,  attention,  perception,  and  pattern  recognition.  Doubt¬ 
lessly  there  are  other  valid  ways  of  categorizing  these  operations 
(7).  [37],  [67].  [100],  [137],  [148],  [175],  [281],  [297],  [298],  [313], 
[327],  [333]  but  the  taxonomy  used  here  is  sufficient  for  our 
purposes.  In  sensation,  information  is  acquired  through  the  five 
major  sense  modalities,  which  are  environmentally  activated,  in 
response  to  a  specific  array  of  stimulus  energies.  In  a  specific 
decisionmaking  situation,  the  decisionmaker  filters  out  bits  of 
data  believed  to  be  irrelevant.  The  filtering  process  is  based  upon 
task  characteristics,  experience,  motivation,  as  well  as  other  fea¬ 
tures  and  demands  of  the  specific  decisionmaking  situation.  If 
such  a  filtering  mechanism  were  not  to  exist,  the  decisionmaker 
would  often  encounter  information  overload  which  generally 
results  in  saturation  and  the  inability  to  process  sufficient  infor¬ 
mation  for  the  task  at  hand.  Short-term  and  long-term  memory 
components  play  key  roles  in  the  information  acquisition  process 
as  the  decisionmaker  proceeds  with  efforts  that  culminate  in 
choice.  A  response  system  couples  the  memory  system  to  the 
sensory  system  and  the  environment.  Thus  it  controls  or  activates 
the  sensory  modalities  on  the  basis  of  the  actions  taken.  Through 
the  response  system  we  close  the  information  flow  feedback  loop. 
Bower,  in  volume  1  of  Estes  [100],  has  summarized  principal 
components  of  the  flow  system.  A  model  of  the  principal  compo¬ 
nents  of  information  flow  might  consist  of:  the  response  system, 
the  sensory  system,  the  memory  system,  and  the  central  processor. 
The  central  processor  coordinates  memorizing,  thinking,  evalua¬ 
tion  of  information,  and  final  decisionmaking. 

Ultimately  involved  in  retention  processes  is  the  notion  of 
attention  [7],  In  order  for  information  to  be  transferred  from 
short-term  memory  to  long-term  memory,  constant  conscious 
attention,  in  terms  of  rehearsal,  is  required.  Information  entering 
short-term  memory  that  is  not  attended  to,  through  specific 
conscious  processes,  is  lost.  Processing  of  information  demands 
attending  to  relevant  bits  of  incoming  data  and  transfer  of  the 
data  into  long-term  memory  for  future  retrieval  for  making  a 
decision.  Interferences  of  various  types  may  interrupt  attention 
and  thus  hinder  transfer  and  retention  of  relevant  stimuli  into 
long-term  memory. 

Inherent  in  the  processing  of  information  acquisition,  is  the 
process  of  pattern  recognition.  This  process  generally  involves 
two  phases:  extraction  and  identification.  A  given  stimulus  is 
“coded”  in  terms  of  its  features.  These  extracted  features  of  the 
object  or  stimulus  d '■scribe  the  stimulus.  The  term  "features” 
implies  such  characteristics  as  angles,  lines,  or  edges.  A  stimulus 
may  be  received  through  any  of  the  sense  modalities.  The  mean¬ 
ing  that  this  conveys  to  the  decisionmaker,  or  the  manner  in 
which  the  decisionmaker  perceives  the  stimulus,  is  dependent 
upon  the  patterns  extracted  from  the  stimulus.  In  the  identifica¬ 
tion  phase,  the  sensory— perceptual  system  classifies  the  stimulus 
object.  The  way  in  which  this  is  often  assumed  to  occur  is  by  a 
weighted  matching  of  the  current  feature  list  against  a  likely  set 
of  prototypes  in  long-term  memory  [7],  [313],  [327],  [354]  with  the 
input  being  classified  according  to  the  name  of  the  best  matching 
prototype.  The  quality  or  extent  of  the  sensory  information 
extracted  determines  the  accuracy  of  identification. 

Thus  pattern  recognition  processes  involve  memory  and  the 
other  three  components  of  information  acquisition:  sensation,  or 
the  initial  experience  of  stimulation  from  the  sensory  modalities; 
attention,  or  the  concentration  of  cognitive  effort  on  sensory 
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Fig.  3.  The  Brunswick  lens  model  and  its  relation  to  Hammond's  social 
judgment  theory. 


stimuli;  and  perception,  or  the  use  of  higher-order  cognition  to 
interpret  sensory  stimuli. 

We  have  just  described  what  might  be  regarded  as  a  compo¬ 
nent  or  physiological  model  of  information  processing.  In  these 
stimulus  response  approaches,  behavior  is  seen  as  being  initiated 
by  the  onset  of  stimuli.  A  seeming  deficiency  in  approaches  of 
this  sort  is  that  there  is  little  consideration  of  how  information 
bits  are  aggregated  to  influence  choice  and  how  the  decision¬ 
maker  goes  about  the  process  of  information  formulation  or 
acquisition,  analysis,  and  interpretation. 

A  lens  model  developed  by  Brunswick  and  his  students  is  a 
notable  exception  to  this.  The  Brunswick  lens  model  is  the  basis 
for  the  policy  capture  or  social  judgement  theory  approach  of 
Hammond  and  his  colleagues  [  1 40]— [  1 43],  The  lens  model,  dis¬ 
played  in  Fig.  3,  assumes  that  people  are  guided  by  rational 
programs  in  their  attempt  to  adapt  to  the  environment.  There  is  a 
criterion  value  Yt„  and  the  subjects  response,  judgment,  or  in¬ 
ference  T,.  The  left  side  of  Fig.  3  represents  ecological  cue 
validities  which  arc  the  correlations  rcl  between  the  cues  and  the 
criterion  value.  On  the  right  or  organismic  side  of  Fig.  3.  a 
subject  will  base  a  response,  judgment,  or  inference  >' ,  on  the 
perceived  ecological  structure.  By  calculating  the  correlations  r„, 
that  exist  between  the  cues  and  the  response  or  criterion  evalua¬ 
tion.  learning  concerning  the  response  system  can  be  obtained. 

We  note  that  the  value  of  the  environmental  criterion  and 


the  subject  inference  i\  arc  directly  comparable  if  linear  combi¬ 
nations  of  the  cues  arc  assumed.  We  have,  for  n  cues. 
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where  hel  and  hfl  are  optimum  regression  weights  for  the  inde¬ 
pendent  cues  x,  which  provide  measures  of  the  importance  weights 
of  the  cues.  v,  and  p,  are  error  terms  due  to  inadequacy  of  the 
linear  model.  V,  and  V,  are  the  true  criterion  value  and  subject 
response,  and  Yt  and  Y,  are  the  predicted  criterion  value  and 
subject  response  based  on  the  observed  cues.  The  many  works  of 
Hammond  and  his  associates  [2],  (21],  [45],  [54],  ( 140]-[  143], 
[186],  [187],  [261],  [290],  (294).  [295],  (404)  concerning  social 
judgment  theory  make  use  of  this  lens  model.  The  approach  has 
been  shown  to  be  useful  in  a  variety  of  areas  such  as  policy 
formulation,  negotiation,  and  conflict  resolution.  Recent  efforts 
by  Hoffman.  Earle,  and  Slovic  [154]  have  shown  that  the  com¬ 
puter  displays  of  social  judgment  theory:  which  show  both  task 
characteristics,  in  terms  of  cue  values  and  corresponding  criterion 
values',  and  response  characteristics,  in  terms  of  individual  cue 
values  and  associated  subject  responses  and  judgments;  provide  a 
very  effective  feedback  mechanism  which  might  enable  people  to 
effectively  learn  much  about  complex  functional  relationships 
and  tasks.  There  are  a  number  of  studies  of  regression  analysis 
approaches  to  determination  of  parameters  for  decision  rules 
[260],  [290|.  Use  of  regression  analysis  is  central  to  social  judg¬ 
ment  theory.  Recent  applications  of  the  approach  [261]  have 
involved  using  simulation  models  to  generate  responses  which  are 
valuated  by  the  decisionmaker. 

Questions  concerning  the  cognitive  style  used  by  the  de¬ 
cisionmaking  are.  we  believe,  very  important.  Information  analy¬ 
sis  and  information  interpretation  may  be  accomplished  in  a 
concrete  operational  mode  of  thought  or  in  a  formal  operational 
mode.  We  will  describe  the  essential  features  of  these  two  higher- 
level  cognition  processes  in  Section  V.  The  concrete  operational 
thought  process,  which  is  typically  applied  in  familiar  situations 
which  people  perceive  to  be  well  structured,  may  involve  efforts 
such  as  reasoning  by  analogy,  or  affect,  or  standard  operating 
procedures.  The  formal  operational  thought  process,  typically 
applied  in  situations  with  which  the  problem  solver  is  unfamiliar 
and  inexperienced,  may  involve  explicit  use  of  quantitative  or 
qualitative  analytical  thought. 

In  either  of  these  modes  or  “styles”  of  thought  or  cognition, 
information  acquisition,  analysis,  and  interpretation  may  be  quite 
flawed.  Many  recent  studies  emphasize  the  strong  need  for  mod¬ 
eling  problem  solving  behavior  in  a  descriptive,  or  positive  sense 
in  order  to  detect  possible  flaws  in  information  processing,  Our 
discussions  thus  far  in  this  section  have  been  concerned  with 
physiological  models  in  which  people  have  input  and  output 
mechanisms,  a  memory  for  information  storage  and  retrieval,  and 
a  central  processor  for  coordination  and  control.  Here,  we  wish 
especially  to  underscore  the  need  not  only  for  physiological  or 
stimulus- response  models  but  especially  for  process  tracing  (72], 
(95-98],  (255]  models  of  information  formulation,  analysis,  and 
interpretation  as  well  as  associated  decisionmaking.  Knowledge 
of  the  actual  unaided  process  of  problem  solving  or  descriptive 
process  tracing  should  serve  as  a  useful  guide  to  the  design  of 
information  systems  that  avoid,  or  at  least  ameliorate  the  effects 
of.  cognitive  heuristics  and  biases.  This  involves  requirements  for 
a  knowledge  of  the  ways  in  which  people  apply  strategies  in  order 
to  reach  judgments. 

A  large  number  of  contemporary  studies  in  cognitive  psychol¬ 
ogy  indicate  that  the  attempts  of  people,  including  experts,  to 
apply  various  intuitive  strategies  in  order  to  acquire  and  analyze 
information  for  purposes  such  as  prediction,  forecasting,  and 
planning  are  often  flawed.  Mans  studies  have  been  conducted  to 
describe  and  explain  the  wav  information  is  acquired  and  analyzed 
and  the  results  of  faulty  acquisition  and  analysis.  Generally  the 
descriptive  behavior  of  subjects  in  tasks  involving  information 
acquisition  and  analysis  is  compared  to  the  normative  results  that 
would  prevail  if  people  followed  an  “optimal"  procedure  There 
have  been  a  number  of  recent  discussions  of  cognitive  biases  from 
several  perspectives  |6I],  (62|.  [98].  |I42|.  [I54|.  |I56|.  [I6<>|.  |I6I|. 
(185).  1 234).  1 263],  [304],  |309|.  (346-349],  [351],  |352|.  (385|.  (3X6). 
[406-408|.  The  recent  texts  bv  Nisbett  and  Ross  [264|  and 
Hogarth  (159]  concerning  the  strategies  and  biases  associated 


with  judgment  and  choice  are  especially  noteworthy.  Among  the 
cognitive  biases  that  have  been  identified  are  several  which  affect 
information  formulation  or  acquisition,  information  analysis,  and 
interpretation.  Among  these  biases,  which  are  not  independent, 
are  the  following. 

/ )  Adjustment  and  Anchoring  [345],  [383]— Often  a  person  finds 
that  difficulty  in  problem  solving  is  due  not  to  the  lack  of  data 
and  information,  but  rather  to  the  existence  of  excess  data  and 
information.  In  such  situations,  the  person  often  resorts  to  heuris¬ 
tics  which  may  reduce  the  mental  efforts  required  to  arrive  at  a 
solution.  In  using  the  anchoring  and  adjustment  heuristic  when 
confronted  with  a  large  amount  of  data,  the  person  selects  a 
particular  datum,  such  as  the  mean,  as  an  initial  or  starting  point, 
or  anchor,  and  then  adjusts  that  value  improperly  in  order  to 
incorporate  the  rest  of  the  data  such  as  to  result  in  flawed 
information  analysis. 

2)  Availability  [383],  [385]— The  decisionmaker  uses  only  easily 
available  information  and  ignores  not  easily  available  sources  of 
significant  information.  An  event  is  believed  to  occur  frequently, 
that  is  with  high  probability,  if  it  is  easy  to  recall  similar  events. 

J)  Base  Rate  [25].  [291],  [386] — The  likelihood  of  occurrence  of 
two  events  is  often  compared  by  contrasting  the  number  of  times 
the  two  events  occur  and  ignoring  the  rate  of  occurrence  of  each 
event.  This  bias  often  occurs  when  the  decisionmaker  has  con¬ 
crete  experience  with  one  event  but  only  statistical  or  abstract 
information  on  the  other.  Generally  abstract  information  will  be 
ignored  at  the  expense  of  concrete  information.  A  base  rate 
determined  primarily  from  concrete  information  may  be  called  a 
causal  base  rate  whereas  that  determined  from  abstract  informa¬ 
tion  is  an  incidental  base  rate.  When  information  updates  occur, 
this  individuating  information  often  is  given  much  more  weight 
than  it  deserves.  It  is  much  easier  for  individuating  information 
to  override  incidental  base  rates  than  causal  base  rates. 

4)  Conservatism  [210],  [259],  [345]— The  failure  to  revise  esti¬ 
mates  as  much  as  they  should  be  revised,  based  on  receipt  of  new 
significant  information,  is  known  as  conservatism.  This  is  related 
to  data  saturation  and  regression  effects  biases. 

5)  Data  Presentation  Context  [161]  — The  impact  of  sum¬ 
marized  data,  for  example,  may  be  much  greater  than  that  of  the 
same  data  presented  in  detailed,  nonsummarized  form.  Also 
different  scales  may  be  used  to  considerably  change  the  impact  of 
the  same  data. 

6)  Data  Saturation  —  People  often  reach  premature  conclusions 
on  the  basis  of  too  small  a  sample  of  information  while  ignoring 
the  rest  of  the  data  that  is  received  later  on,  or  stopping  acquisi¬ 
tion  of  data  prematurely. 

7)  Desire  (or  Self-Fulfilling  Prophecies  —  The  decisionmaker  val¬ 
ues  a  certain  outcome,  interpretation,  or  conclusion  and  acquires 
and  analyzes  only  information  that  supports  this  conclusion.  This 
is  another  form  of  selective  perception. 

H)  Fuse  of  Recall  [205],  [382],  [383]  — Data  which  can  easilv  be 
recalled  or  assessed  will  affect  perception  of  the  likelihood  of 
similar  events  occurring  again.  People  typically  weigh  easily 
recalled  data  more  in  decisionmaking  than  those  data  which 
cannot  easily  be  recalled. 

VI  expectations  [161],  [235]  -  People  often  remember  and  at¬ 
tach  higher  validity  to  information  which  confirms  their  previ¬ 
ously  held  beliefs  and  expectations  lhan  they  do  to  disconfirming 
information.  Thus  the  presence  of  large  amounts  of  information 
makes  it  easier  for  one  to  selectively  ignore  disconfirming  infor¬ 
mation  such  as  to  reach  anv  conclusion  and  thereby  prove 
anything  that  one  desires  to  prove 

III)  Fact- Caine  Confusion  -Strongly  held  values  mav  often  be 
regarded  and  presented  as  facts  That  tvpe  of  information  is 
sought  which  confirms  or  lends  credibility  to  one's  views  and 
values.  Information  which  contradicts  one's  views  or  values  is 
ignored  This  is  related  to  wishful  thinking  in  that  both  are  forms 
of  selective  perception. 

Ill  Fundamental  Attribution  F.rror  t Success / Failure  Error)  [263]. 
[264]  — The  decisionmaker  associates  success  with  personal  inher¬ 
ent  ability  and  associates  failure  with  poor  luck  in  chance  events. 


648 


IEEE  TRANSACTIONS  ON  SYSTEMS.  MAN.  AND  CYBERNETICS.  VOL.  SMC-11.  NO.  9.  SEPTEMBER  1981 


This  is  related  to  availability  and  representativeness. 

12)  Gamblers  Fallacy—  The  decisionmaker  falsely  assumes  that 
unexpected  occurrence  of  a  “run"  of  some  events  enhances  the 
probability  of  occurrence  of  an  event  that  has  not  occurred. 

13)  Habit— Familiarity  with  a  particular  rule  for  solving  a 
problem  may  result  in  reutilization  of  the  same  procedure  and 
selection  of  the  same  alternative  when  confronted  with  a  similar 
type  of  problem  and  similar  information.  We  choose  an  alterna¬ 
tive  because  it  has  previously  been  acceptable  for  a  perceived 
similar  purpose  or  because  of  superstition. 

14)  Hindsight  [112-114],  [116]— People  are  often  unable  to 
think  objectively  if  they  receive  information  that  an  outcome  has 
occurred  and  they  are  told  to  ignore  this  information.  With 
hindsight,  outcomes  that  have  occurred  seem  to  have  been  inevi¬ 
table.  We  see  relationships  much  more  easily  in  hindsight  than  in 
foresight  and  find  it  easy  to  change  our  predictions  after  the  fact 
to  correspond  to  what  we  know  has  occurred. 

15)  Illusion  of  Control  [209],  [210] — A  good  outcome  in  a 
chance  situation  may  well  have  resulted  from  a  poor  decision. 
The  decisionmaker  may  assume  a  feeling  of  control  over  events 
that  is  not  reasonable. 

lb)  Illusion  of  Correlation  [115],  [383] — A  mistaken  belief  that 
two  events  covary  when  they  do  not  covary  is  known  as  the 
illusion  of  correlation. 

17)  Law  of  Small  Numbers  (see  Kahneman  and  Tverskv 
[235]) — People  are  insufficiently  sensitive  to  quality  of  evidence. 
They  often  express  greater  confidence  in  predictions  based  on 
small  samples  of  data  with  nondisconfirming  evidence  than  in 
much  larger  samples  with  minor  disconfirming  evidence.  Sample 
size  and  reliability  often  have  little  influence  on  confidence. 

18)  Order  Effects  [161],  [184]— The  order  in  which  information 
is  presented  affects  information  retention  in  memory.  Typically 
the  first  piece  of  information  presented  (primacy  effect)  and  the 
last  presented  (recency  effect)  assume  undue  importance  in  the 
mind  of  the  decisionmaker. 

19)  Outcome  Irrelevant  Learning  System  [96],  [97]  — Use  of  an 
inferior  processing  or  decision  rule  can  lead  to  poor  results  and 
the  decisionmaker  can  believe  that  these  are  good  because  of 
inabilitv  to  evaluate  the  impacts  of  the  choices  not  selected  and 
the  hypotheses  not  tested. 

20)  Overconfidence  [114],  [183],  [216]— People  generally  ascribe 
more  credibility  to  data  than  is  warranted  and  hence  overestimate 
the  probability  of  success  merely  due  to  the  presence  of  an 
abundance  of  data.  The  greater  the  amount  of  data,  the  more 
confident  the  person  is  in  the  accuracy  of  the  data. 

21)  Redundancy— The  more  redundancy  in  the  data,  the  more 
confidence  people  often  have  in  their  predictions,  although  this 
overconfidence  is  usually  unwarranted. 

22)  Reference  Effect  [30],  [383]— People  normally  perceive  and 
evaluate  stimuli  in  accordance  with  their  press...  .aid  past  experi¬ 
ential  level  for  the  stimuli.  They  sense  a  reference  level  in 
accordance  with  past  experience.  Thus  reactions  to  stimuli,  such 
as  a  comment  from  an  associate,  are  interpreted  favorably  or 
unfavorably  in  accordance  with  our  previous  expectations  and 
experiences.  A  reference  point  defines  an  operating  point  in  the 
space  of  outcomes.  Changes  in  perceptions  due  to  changes  in  the 
reference  point  arc  called  reference  effects.  These  changes  may 
not  be  based  upon  proper,  statistically  relevant  computations. 

23)  Regression  Effects  [IK3|.  [383]  — The  largest  observed  values 
of  observations  arc  used  without  regressing  towards  the  mean  to 
consider  the  effects  of  noisy  measurements.  In  effect  this  ignores 
uncertainties. 

24)  Representativeness  [382],  [383|  —  When  making  inference 
from  data  too  much  weight  is  given  to  results  of  small  samples. 
As  sample  size  is  increased,  the  results  of  small  samples  are  taken 
to  be  representative  of  the  larger  population.  The  "laws"  of 
representativeness  differ  considerably  from  the  laws  of  proba¬ 
bility  and  violations  of  the  conjunction  rule  P{ .4  O  B)  P{.4) 
are  often  observed. 


25)  Selective  Perceptions  [161]— People  often  seek  only  infor¬ 
mation  that  confirms  their  views  and  values.  They  disregard  or 
ignore  disconfirming  evidence.  Issues  are  structured  on  the  basis 
of  personal  experience  and  wishful  thinking.  There  are  many 
illustrations  of  selective  perception.  One  is  “reading  between  the 
lines"  such  as.  for  example,  to  deny  antecedent  statements  and. 
as  a  consequence,  accept  “if  you  don’t  promote  me.  I  won't 
perform  well”  as  following  inferentially  from  “1  will  perform  well 
if  you  promote  me.” 

26)  Spurious  Cues  [161]— Often  cues  appear  only  by  occur¬ 
rence  of  a  low  probability  event  but  they  are  accepted  by  the 
decisionmaker  as  commonly  occurring. 

27)  Wishful  Thinking— The  preference  of  the  decisionmaker 
for  particular  outcomes  and  particular  decisions  can  lead  the 
decisionmaker  to  choose  an  alternative  that  the  decisionmaker 
would  like  to  have  associated  with  a  desirable  outcome.  This 
implies  a  confounding  of  facts  and  values  and  is  a  form  of 
selective  perception. 

Doubtlessly  there  are  other  information  acquisition,  analysis, 
and  interpretation  biases  that  we  have  not  identified  here.  Any 
categorization  into  acquisition,  analysis,  and  interpretation  bias  is 
somewhat  arbitrary  since  iteration  and  feedback  will  often,  in 
practice,  not  allow  this  separation.  Also,  many  of  the  identified 
biases  overlap  in  meaning  and.  therefore,  are  related  to  others. 
Some  further  discussion  of  cognitive  biases  will  be  presented  in 
our  discussion  of  the  situation  framing  phase  of  prospect  theory 
in  Section  III.  Certainty,  reflection,  and  isolation  effects  arc  three 
results  of  these  biases  that  have  particular  prominence  in  pro¬ 
spect  'theory. 

Of  particular  interest  are  circumstances  under  which  these 
biases  occur,  their  effects  on  activities  such  as  decisionmaking, 
issue  resolution,  planning,  and  forecasting  and  assessment;  and 
appropriate  styles  which  might  result  in  debiasing  or  amelioration 
of  the  effects  of  cognitive  bias. 

Manv  of  the  cognitive  biases  that  have  been  found  to  exist 
have  been  found  in  the  unfamiliar  surroundings  of  the  experi¬ 
mental  laboratory,  and  generalization  of  this  work  to  real  world 
situations  is  a  contemporary  research  area  of  much  interest. 
However  most  of  the  laboratory  experiments  have  concerned  very 
simple  if  unfamiliar  tasks.  A  number  of  studies  have  compared 
unaided  expert  performance  with  simple  quantitative  models  for 
judgment  and  decisionmaking,  such  as  those  by  Brehmer  [47], 
Cohen  [62],  Dawes  [70],  [71],  Goldsmith  [132],  Klcinmuntz  and 
Kicinmuntz  [204],  and  by  several  authors  in  Wallstcin’s  recent 
definitive  work  concerning  cognitive  processes  in  choice  and 
decision  behavior  ]396].  While  there  is  controversy  [62],  [263], 
[349],  most  studies  have  shown  that  simple  quantitative  models 
perform  better  in  human  judgment  and  decisionmaking  tasks, 
including  information  processing,  than  wholistic  expert  perfor¬ 
mance  in  similar  tasks.  This  would  appear  to  have  major  implica¬ 
tions  and  to  sound  major  caveats  for  such  areas  as  “expert 
forecasting."  This  caution  is  strongly  emphasized  in  the  works  of 
Hogarth  and  Makridakis  [161],  Makridakis  and  Whcelright  [235], 
and  Armstrong  [l4]-[  16).  This  is  a  caution  noted  in  but  a  few  [18] 
of  the  contemporary  works  on  forecasting  and  assessment. 

There  arc  a  number  of  prescriptions  which  might  be  given  to 
encourage  avoidance  of  possible  cognitive  biases  and  to  debias 
those  that  do  occur  [96],  [98],  [  161  ].  [  184).  [235],  [355],  [386].  Some 
suggestions  to  avoid  cognitive  bias  follow. 

1)  Sample  information  from  a  broad  data  base  and  be  espe¬ 
cially  careful  to  include  data  bases  which  might  contain  discon¬ 
tinuing  information. 

2)  Include  sample  s  »e.  confidence  intervals,  and  other  mea¬ 
sures  of  information  validitv  in  addition  to  mean  values. 

3)  Encourage  use  of  models  and  quantitative  aids  to  improve 
upon  information  analysis  through  proper  aggregation  of  acquired 
information. 

4)  Avoid  the  hindsight  bias  by  providing  access  to  information 
at  critical  past  times. 
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5)  Encourage  decisionmakers  to  distinguish  good  and  bad 
decisions  from  good  and  bad  outcomes  in  order  to  avoid  various 
forms  of  selective  perception  such  as,  for  example,  the  illusion  of 
control. 

6)  Encourage  effective  learning  from  experience.  Encourage 
understanding  of  the  decision  situation  and  methods  and  rules 
used  in  practice  to  process  information  and  make  decisions  such 
as  to  avoid  outcome  irrelevant  learning  systems. 

7)  Use  structured  frameworks  based  on  logical  reasoning  [255], 
[376]  in  order  to  avoid  confusing  facts  and  values  and  wishful 
thinking  and  to  assist  in  processing  information  updates. 

8)  Both  qualitative  and  quantitative  data  should  be  collected, 
and  all  data  should  be  regarded  with  “appropriate"  emphasis. 
None  of  the  data  should  be  overweighted  or  underweighted  in 
accordance  with  personal  views,  beliefs,  or  values  only. 

9)  People  should  be  reminded,  from  time  to  time,  concerning 
what  type  or  size  of  sample  from  which  data  are  being  gathered, 
so  as  to  avoid  the  representativeness  bias. 

10)  Information  should  be  presented  in  several  orderings  so  as 
to  avoid  recency  and  primacy  order  effects,  and  the  data  presen¬ 
tation  context  and  data  saturation  biases. 

Kahneman  and  Tversky  [235]  discuss  a  systemic  procedure  to 
enhance  debiasing  of  information  processing  activities.  A  defini¬ 
tive  discussion  of  debiasing  methods  for  hindsight  and  overconfi¬ 
dence  is  presented  by  Fischhoff  [  1 85].  Lichtenstein  and  Fischhoff 
present  a  number  of  helpful  guidelines  to  assist  in  training  for 
calibration  [217],  Clearly  more  efforts  along  these  lines  are  needed. 
Studies  to  determine  the  extent  to  which  learning  feedback 
acquired  through  use  of  methods  such  as  social  judgment  theory 
contributes  to  debiasing  would  be  especially  rewarding.  This  is 
especially  the  case  since  confidence  in  unaided  judgment  is 
learned  and  maintained  through  feedback  even  when  there  is  very 
little  or  no  justification  for  this  confidence  [94],  Typically  out¬ 
comes  which  follow  from  decisions  based  on  negative  judgments 
are  not  observed.  Reinforcements  of  self-fulfilling  prophecy  type 
judgments  through  positive  outcome  feedback  only  occur  in  spite 
of.  rather  than  due  to,  judgment  validity. 

Research  integrating  the  methods  whereby  people  integrate  or 
aggregate  information  and  attribute  causes  [8]— [  1 2],  [142],  [143], 
[186],  [190],  [199],  [321],  [364]  with  methods  for  the  identification 
and  amelioration  of  cognitive  biases  would  be  of  interest  and  of 
much  potential  use  also. 

In  a  sense,  the  results  of  this  section  are  disturbing  in  that  they 
tend  to  support  the  “intellectual  cripple”  hypothesis  of  Slovic 
([142],  pg.  14)  and  imply  that  humans  may  well  be  little  more 
than  masters  of  the  art  of  self  deception.  On  the  other  hand  there 
is  strong  evidence  that  humans  are  very  strongly  motivated  to 
understand,  to  cope  with,  and  to  improve  themselves  and  the 
environment  in  which  they  function.  While  there  are  a  number  of 
fundamental  limitations  to  systemic  efforts  to  assist  in  bettering 
the  quality  of  human  judgment,  choice,  and  decisions  [282],  [307], 
there  are  also  a  number  of  desirable  activities  [16],  [305],  [385]. 
These  can  assist  in  increasing  the  relevance  of  systemic  ap¬ 
proaches  such  as  those  which  result  in  information  processing 
adjuvants  for  policy  analysis,  forecasting,  planning,  and  other 
judgment  and  decision  tasks  in  which  information  acquisition, 
analysis,  and  interpretation  play  a  needed  and  vital  role. 

IV.  Decision  Rites 

In  order  to  select  an  alternative  plan  or  course  of  action  for 
ultimate  implementation,  the  decisionmaker  applies  one  or  more 
decision  rules  which  enable  comparison  prioritization,  and  ulti¬ 
mately.  selection  of  a  single  policy  alternative  from  among  a  set 
of  choice  alternatives.  The  purpose  of  a  decision  rule  is  to  specify 
the  most  preferred  alternative  generallv  from  a  partial  or  total 
ordering  or  prioritization  of  alternatives.  To  utilize  a  decision  rule 
we  must  have  a  set  of  alternatives,  a  set  of  objectives  to  be 
accomplished  by  the  alternatives,  a  knowledge  of  the  impacts  of 


the  alternatives,  evaluation  of  these  impacts,  and  associated  pref¬ 
erence  information.  Decision  rules  may  be  explicit  or  implicit  in 
terms  of  the  way  in  which  they  are  used  in  the  decision  process. 

We  can  assume,  without  loss  of  generality,  that  each  single 
policy  alternative  may  represent  a  complex  portfolio  of  individual 
alternatives  and  that  the  set  of  choice  alternatives  contains  mutu¬ 
ally  exclusive  components.  This  formulation  can  always  be 
accomplished  but  may  result  in  a  very  large  set  of  policy  alterna¬ 
tives  since  n  individual  alternatives  can  be  combined  into  2" 
possible  portfolios  of  alternatives.  Failure  to  consider  a  combina¬ 
tion  of  alternatives  may  result  in  significant  errors  in  decision¬ 
making  unless  each  of  the  individual  alternatives  represents  one 
component  of  a  portfolio  of  all  possible  combinations  of  individ¬ 
ual  alternatives,  or  unless  the  individual  alternatives  are  indepen¬ 
dent  or  mutually  exclusive. 

It  is  assumed  at  the  interpretation  step  of  the  decision  process 
that  formulation  and  analysis  have  been  accomplished  such  that 
there  exists  a  decision  situation  structural  model  and  the  results 
of  exercising  the  model.  Thus  objectives,  relevant  constraints, 
some  bounds  on  the  issue,  possible  policy  alternatives,  impacts  of 
policy  alternatives,  etc.  are  assumed  known.  The  choice  of  a 
decision  rule  will  depend,  in  large  measure,  upon  the  decision 
situation  structural  model  as  reflected  in  the  contingency  task 
structure.  We  will  discuss  dynamic  models  for  contingency  task 
structures  in  our  next  section. 

The  above  discussion  may  appear  representative  primarily  of 
the  judgment  and  decision  process  associated  with  the  formal 
operational  thought  model  that  we  will  elaborate  upon  in  our 
next  section.  For  purposes  of  clarity  of  exposition,  we  have 
presented  an  oversimplified  view  of  how  decision  rules  are  used 
to  aggregate  information  and  evaluate  alternatives.  The  sequence 
we  have  described  implies  comparison  and  evaluation  of  alterna¬ 
tives  only  after  we  have  first  accomplished  formulation  and 
analysis  of  the  issue  under  consideration.  As  we  have  noted 
throughout  our  discussion,  decisionmakers  typically  compare  and 
evaluate  alternatives  while  they  are  in  the  process  of  decision 
situation  formulation  and  analysis.  These  partial  comparisons 
and  Evaluations  lead  to  searches  for  additional  policy  alterna¬ 
tives,  additional  analysis,  etc.  As  we  have  also  noted,  the  entire 
decision  process  typically  occurs  in  a  parallel-simultaneous- 
iterative  fashion  rather  than  an  exclusively  sequential  series  of 
steps  in  which  formulation  is  followed  by  analysis  which  is 
followed  by  interpretation. 

Individuals  and  decision  environments  vary  so  greatly  that 
there  are  a  great  number  of  decision  rules  that  will  be  needed  to 
describe  actual  decision  situations.  Schoemaker  [315]  is  among  a 
number  of  authors  [121],  [255],  [364],  [365],  [372]  who  have 
attempted  classification  schemes  to  allow  categorization  of  vari¬ 
ous  descriptive  decision  rule  models.  His  first  level  categorization 
separates  decision  rules  into  holistic  and  nonholistic  categories. 
In  a  holistic  decision  rule  each  alternative  or  portfolio  of  alterna¬ 
tives  is  evaluated  and  assigned  a  value  or  utility.  After  all 
alternatives  have  been  evaluated,  they  are  compared  and  alterna¬ 
tive  A  is  said  to  be  preferred  to  alternative  B  if  its  evaluation  has 
given  it  a  greater  utility  such  that  l/(.4)  >  U(B).  In  nonholistic 
decision  rules  individual  alternatives  or  portfolios  of  alternatives 
are  generally  compared  with  one  another  in  a  sequential  elimina¬ 
tion  process.  This  comparison  may  be  against  some  standard 
across  a  few  attributes  within  alternative  pairs  or  across  alterna¬ 
tives.  with  alternative  attributes  being  compared  one  at  a  time. 

Each  of  these  categories  appears  to  imply  disaggregation  into 
components  of  the  event  outcomes  likely  to  follow  from  deci¬ 
sions.  Our  section  on  contingency  task  structure  models  will 
propose  a  dynamic  evolving  cognitive  style  model  which  admits 
of  expert  situational  understanding  that  involves  reasoning  by 
analogy,  intuitive  affect,  and  other  forms  of  nonverbal  almost 
unconscious  perception  We  elect  to  call  this  type  of  reasoning 
wholistic  and  add  a  third  category  to  the  classification  scheme  of 
Schoemaker. 
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Consequently  we  envision  three  first  level  general  categories 
of  decision  rules:  holistic,  heuristic,  and  wholistic.  In  a  holistic 
decision  rule  there  is  an  attempt  to  consider  all  aspects  of  a 
decision  situation  in  evaluating  choices  by  means  of  disaggrega¬ 
tion  of  various  choice  components.  In  a  heuristic  decision  rule, 
detailed  complicated  comparisons  are  not  used.  Rather,  sim¬ 
plified  approximations  to  holistic  decision  rules  are  used.  In  a 
wholistic  decision  rule,  the  evaluation  and  choice  of  alternatives  is 
based  upon  use  of  previous  experience,  hopefully  true  expertise, 
with  respect  to  similar  decision  situations.  The  selection  of  an 
alternative  is  based  upon  its  perceived  or  presumed  worth  as  a 
whole  and  without  detailed  conscious  consideration  of  the  indi¬ 
vidual  aspects  of  each  alternative.  It  is  possible  to  define  a 
number  of  decision  rules  and  categorize  them.  The  first  level 
categories  we  have  defined  are  not  mutually  exclusive.  A  number 
of  decision  rules  doubtlessly  can  be  categorized  into  more  than 
one  of  these  first-level  decision  categories.  Figure  4  illustrates  a 
possible  inclusion  structure  for  the  decision  rules  we  will  describe 
here. 

Expected  Utility  Theon:  Our  first  decision  rule  is  based  on 
expected  utility  theory  and  is  doubtlessly  the  most  familiar  deci¬ 
sion  rule  to  engineers.  This  rule  derives  from  a  “rational  actor  ’2 
decision  modef[3).  [4).  [89].  [1031.  [121],  [134],  [169],  [192],  [222], 
[256],  [2651.  [285).  [315],  (3591.  (397)  which  is  tnore  fully  discussed 
in  Section  VI. 

The  rational  actor  model  is  a  normative  model.  Von  Neuman 
and  Morgcnstem.  who  introduced  the  axioms  of  the  model  of 
rational  man.  'tated  the  purpose  of  their  work  as 

to  find  mathematically  complete  principles  which  define  "rational 
behavior”  a  set  of  rules  for  each  participant  which  tell  him  how¬ 
to  behave  in  every  situation  which  mav  conceivable  arise. 

The  idea  of  rationality  originated  in  the  economics  literature 
where  microeconomic  models  of  the  consumer  and  the  firm 
assumed  complete  information  and  rationality.  The  rational  per¬ 
son  is  assumed  to  have  identified  a  set  of  well-defined  objectives 
and  goals  and  is  assumed  to  be  able  to  express  preferences 
between  different  states  of  affairs  according  to  the  degree  of 
satisfaction  of  attaining  these  objectives  and  goals.  A  rational 


:  Technological  or  economic  rauonahlv  would  be  a  more  appropriate 
term. 


person  has  identified  available  alternative  courses  of  action  and 
the  possible  consequences  of  each  alternative.  The  rational  person 
makes  a  consistent  choice  of  alternative  actions  in  order  to 
maximize  the  expected  degree  of  satisfaction  associated  with 
attaining  identified  objectives  and  goals. 

A  number  of  elements  are  assumed  to  exist  in  the  rational 
actor  model: 

1)  a  set  of  policy  alternatives  A ; 

2)  the  set  of  possible  consequences  of  choice  or  future  states  of 
nature  or  decision  outcomes  called  S; 

3)  a  utility  function  U(s)  that  is  defined  lor  all  elements  s 
of  S; 

4)  information  as  to  which  outcomes  will  occur  if  a  particular 
policy  alternative  a  in  A  is  chosen;  and 

5)  information  as  to  the  probability  of  occurrence  of  any 
particular  outcome  if  an  alternative  a  G  A  is  chosen.  Pa(s) 
is  the  probability  that  s£S  will  occur  if  a  £  A  is  chosen. 

There  are  a  number  of  ways  in  which  the  axioms  associated  with 
the  rational  actor  model  may  be  stated.  Each  statement  of  the 
axioms  allows  proof  of  the  fact  that  cardinal  utility  functions  will 
exist  and  be  unique  only  up  to  positive  linear  transformations. 
Further,  the  evaluation  of  expected  utility  allows  choicemaking 
and  prioritization  of  alternatives  in  accordance  with  the  expected 
utility  of  each  alternative.  There  are  a  number  of  textbook 
accounis  of  expected  utility  theory  to  which  the  interested  reader 
of  this  review  may  turn  for  alternative  sets  of  axioms  and  detailed 
accounts  of  the  use  of  expected  utility  theory  (51).  1163).  [196], 
[222],  [285],  (302],  [315].  MacCrimmon  and  Larson  interrelate  the 
major  axiom  svstems  in  expected  utility  theory  [3[  in  a  note¬ 
worthy  contribution  to  understanding  of  the  several  systems  that 
lead  to  (essentially)  the  same  results  for  the  rational  actor  model. 
A  very  readable  introductory  trcamicnt  of  expected  utility  theory, 
relating  descriptive  psychological  concerns  with  normative  con¬ 
cerns.  is  presented  by  Vick  (244). 

The  rational  actor  model  is  often  accepted  as  a  normative 
model  of  how  decisions  should  be  made,  at  least  in  a  substantive 
or  “as  if”  fashion.  It  is  often  observed  that  the  model  is  not  an 
accurate  description  of  either  the  substance  or  the  process  of 
actual  unaided  choicemaking  behavior.  Some  of  these  observers 
use  empirical  evidence  of  the  deviation  of  actual  decisionmakers 
from  either  substantive  rationality  or  process  rationality.  These 
observations  are  doubtlessly  correct.  The  rational  actor  model  is. 
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however,  invaluable  in  that  it  can  be  often  used  as  reference  for 
comparison  of  actual  behavior  with  ideal  “aided"  or  normative 
behavior.  Further,  it  provides  a  benchmark  against  which  to 
compare  simplified  heuristics.  Our  efforts  and  discussions  in  this 
section  concern  primarily  substantive  behavior  although  we 
recognize  the  great  difficulty,  in  practice,  of  separating  substance 
from  process. 

Simon  and  his  colleagues  introduced  the  concept  of  hounded 
rationality  and  developed  a  satisficing  model  for  individual 
choicemaking.  It  is  worth  noting  that  boundedlv  rational  actors 
are  basically  rational  subject  to  constraints  on  the  formulation, 
analysis,  and  interpretation  of  information,  and  the  substitution 
of  achievement  of  a  target  level  of  return,  or  aspiration  level,  for 
selection  of  the  best  alternative.  Typically  people  satisfice  by 
adaptive  adjustment  [72]  of  aspirations  such  that,  in  repetitive 
decision  situations,  optimizing  behavior  is  approached  [270|. 

There  is  absolutely  nothing  in  the  formulation  of  the  rational 
actor  model  which  requires  identification  of  all  objectives,  all 
possible  alternatives,  all  possible  impacts  of  alternatives,  etc.  The 
rational  actor  model  is  perfectly  capable  of  being  used  to  allow 
prioritization  and  selection  c.  the  best  alternative  by  evaluating 
some  impacts  and  with  knowledge  of  some  objectives,  from 
among  an  incomplete  set.  It  in  no  sense  necessarily  requires 
completeness  in  everything  and  the  associated  complexity  that 
this  would  require.  Actual  decisionmaking  behavior  may  not. 
however,  even  be  boundedlv  rational  but  may  employ  such  poor 
heuristics  as  to  result  in  inferior  choicemaking  even  to  the  extent 
of  selecting  inferior  choices  from  among  those  in  a  bounded  set. 

There  have  been  a  number  of  experimental  studies  and  field 
studies  of  the  appropriateness  of  the  expected  utility  model  [3J. 
(III).  (117).  [1191.  (125).  1184]-|IH6).  |2361. 13361-1341],  [385)  as  a 
descriptive  model  of  substantive  unaided  behavior.  Among  the 
surveys  which  comment  upon  the  experimental  and  field  studies 
are  (27|.  (98(,  (2061.  [348J,  (372).  Schocmakcr  (315(  provides  a  very 
readable  brief  survey  of  some  of  this  literature.  While  the  evi¬ 
dence  is  mixed,  most  studies  indicate  that  the  expected  utility 
decision  rule  simply  does  not  function  well  in  a  descriptive 
substantive  sense. 

In  its  simplest  form  the  expected  utility  of  alternative  a,  is 
computed  from 

=  2  phM.) MM**.)]  0) 

/=■ 

where  the  s,{at),j  =  1,2 . n.  arc  the  states  which  may  result 

from  alternative  a,  and  thep(r,(o, )]  arc  the  associated  probabili¬ 
ties.  In  the  expected  utility  formulation  the  p[r((u,))  =  pt(a,)  = 
pt  arc  assumed  to  be  objective  probabilities  and,  of  course. 
1"  i  p,  =  1.  Generally  these  probabilities  arc  not  alternative  in¬ 
variant  although  notationally  they  are  sometimes  written  as  if 
they  were  independent  of  alternatives.  The  t/[.v,(a,)]  are  the 
utilities  or  values  (296j  of  the  decisionmaker  for  the  various 
outcome  states.  Johnson  and  Huber  (179)  survey  a  number  of 
procedures  that  can  be  used  to  elicit  utility  functions.  Most  of  the 
textbooks  cited  earlier  also  contain  discussion  of  utility  assess¬ 
ment  procedures. 

Suhiective  l:\pected  Lulus:  Often  it  occurs  that  objective  prob¬ 
abilities  are.  for  anv  of  a  variety  of  reasons,  unavailable  in  a  men 
situation.  The  suhiective  expected  utility  model  is  obtained  when 
subjective  probabilities  H  pt  |  are  substituted  for  the  p,  in  ( I )  The 
/<  p  I  are  generally  elicited  such  that  2!"  ,/(/>,)  I  and  so  the 
subjective  probabilities  behave  in  a  wav  consistent  with  the  laws 
of  probability  There  are  a  number  of  discussions  concernin'; 
probability  elicitation  (31).  [223|.  (257).  [355|  that  present  ap¬ 
propriate  procedures  to  enable  determination  of  subjective  proba¬ 
bilities  from  individuals  and  groups  Conventional  approaches  to 
elicitation  of  utility  in  expected  utility  theory  mav  confound 
strength  of  preference  felt  for  alternative  event  outcomes  and 
attitude  toward  risk.  Also  the  elicitation  procedure  can  become 


cumbersome.  Recent  research  has  formally  separated  these  fac¬ 
tors  |33]  and  shows  much  promise  in  enhancing  understanding  of 
attitude  towards  risk.  In  this  approach  the  utility  concept  is 
devoid  of  risk.  It  takes  on  a  meaning  more  like  that  in  conven¬ 
tional  microeconomics  where  it  measures  strength  of  preference 
for  certain  outcomes  only.  This  research  (33)  could  provide  addi¬ 
tional  linkages  and  understanding  between  the  expected  utility 
and  subjective  expected  utility  concepts  by  providing  for  incorpo¬ 
ration  of  risk  aversion  effects  in  a  relatively  simple  way.  A  related 
approach  to  incorporation  of  risk  aversion  is  described  by 
Howard  and  decision  analysts  at  the  Stanford  Research  Institute 
(164)  who  have  been  responsible  for  a  number  of  major  applica¬ 
tion  studies  in  this  area.  There  have  been  a  number  of  related 
approaches  (65).  [66],  [121]  and  the  subjects  of  risk  and  uncer¬ 
tainty  are  of  much  contemporary  interest  (6).  [136],  [153],  [304], 

A  number  of  studies  have  indicated  that  the  relation  between 
subjective  and  objective  probabilities  is  nonlinear  and  situation 
dependent.  It  is  usually  indicated  that  people  often  underestimate 
high  probabilities  and  overestimate  low  ones.  More  recent  re¬ 
search  has  indicated  that  this  appears  true  only  for  favorable 
outcomes.  Just  the  opposite  appears  true  when  the  outcome  is 
unfavorable.  This  appears  to  be  a  form  of  wishful  thinking  for 
low  probability  events  and  “everything  bad  happens  to  me”  for 
high  probabilities.  What  we  will  call  subjective  utility  theory 
attempts  to  incorporate  situation  dependent  nonlineanties  that 
may  exist  between  subjective  and  objective  probabilities. 

Multiattribute  Outcomes:  Often  decision  situations  are  suffi¬ 
ciently  complex  that  it  is  difficult  to  evaluate,  in  a  wholistic 
fashion,  the  utility  of  each  outcome.  Often  it  is  possible  to 
disaggregate  the  features  on  which  utility  is  based  into  a  number 
of  components  called  attributes.  An  attribute  tree  is  a  hierarchical 
structure  which,  when  quantified  through  elicitation  of  values  of 
the  outcomes  on  the  lowest  level  attributes  and  relative  weights  of 
the  attributes,  can  be  used  to  determine  the  utility  of  event 
outcomes.  The  types  of  multiattributc  utility  models  used  have 
varied  from  very  simple  unit  weight  linear  models  to  rather 
complex  multiplicative  models  ( 106).  Dawes  [71]  documents  the 
robust  beauty  of  linear  models  of  the  form 

m  m 

U(s,)=  Ih,u,(s,).  2>,  =  1  (2) 

j  =  i  j~ 1 

where  there  are  assumed  to  be  m  attributes.  ht  is  the  weight  of  the 
j  th  attribute  and  the  value  score  on  the  yth  attribute  of 

outcome  r,.  In  much  of  the  work  in  this  area  decisions  under 
certainty  are  considered  such  that  there  is  a  one  to  one  correspon¬ 
dence  between  alternative  u,  and  outcome  s,.  Under  decision- 
under-certaintv  conditions  we  can  let  .r,  =  a ,  in  (2). 

Multiattributc  models  have  been  very  successfully  used  to 
predict  the  decision  behavior  in  field  settings  or  many  profes¬ 
sional  groups.  Hammond  [I40]-(142]  and  his  colleagues  have,  as 
discussed  in  Section  III.  developed  an  approach  known  as  social 
judgment  theory  in  which  the  “policy"  of  the  decisionmaker, 
equivalent  in  this  circumstance  to  the  weights  h r  arc  identified 
front  wholistic  prioritization  of  decision  outcomes  through  use  of 
regression  analysis  techniques.  Ward  Edwards  and  his  colleagues 
|IX6|.  [301]  and  elsewhere,  elicit  weights  from  decisionmakers  for 
the  model  of  (2)  in  a  useful  straightforward  procedure  called 
simple  multiple  attribute  ranking  technique  (SMART)  that  has 
seen  a  number  of  realistic  applications.  Results  of  the  surveys  of 
Armstrong  [  14],  [  15]:  Fischer  1 1  1 1 1.  Slovic  and  Lichtenstein  [345], 
Slovic.  l  ischhoff.  and  Lichtenstein  |34X|:  Shanteau  |324|.  and 
others  indicate  that  simple  linear  models  |64|  are  verv  potent 
predictors  ol  reliable  judgment,  especially  under  conditions  of 
certainty  in  that  one  can  replicate  the  substantive  tudgment  of 
decisionmakers  This  is  the  case  even  though  the  simple  linear 
model  mav  not  do  a  very  good  job  of  modeling  the  decision 
process.  "Hoot  strapping"  is  the  name  given  to  the  task  of 
substituting  a  decision  rule  for  the  decisionmaker.  The  studies  in 
the  cited  references  show  that  the  elimination  of  human  judgment 
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error  made  possible  by  boot  strapping  enables  it  to  be  superior  to 
unaided  human  judgment.  One  can  even  misspecifv  weights  and 
ignore  attribute  dependencies  and  still  find  that  weighted  linear 
models  do  quite  well  [71]. 

The  fact  that  the  weighted  linear  rule  may  be  so  good  is  a 
rather  mixed  blessing.  In  circumstances  in  which  there  is  no 
requirement  for  knowledge  of  the  underlying  decision  process, 
the  substantive  predictive  ability  of  the  linear  additive  model  may 
make  it  quite  useful.  Situations  such  as  evaluating  credit  card 
applicants  or  applicants  for  admissions  to  colleges  are  repetitive 
judgment  and  decision  situations  which  fit  into  this  category.  Use 
of  simple  formal  linear  model  may  well,  in  situations  such  as 
these,  lead  to  a  more  efficient  as  well  as  more  effective  and 
equitable  selection  process  than  one  based  on  unaided  human 
intuition  [70],  [71],  (Dawes  in  Shweder  [332]).  In  unstructured  or 
semistructurcd  nonrepetitive  decision  situations  it  is  much  less 
clear  that  a  decision  rule  that  is  not  guaranteed  to  be  faithful  to 
the  underlying  decision  process  will  be  nearly  as  valuable  as  one 
that  is  in  terms  of  enabling  decisionmakers  to  make  better 
decisions.  Fischhoff.  Goitein.  and  Shipira  [119]  provide  a  number 
of  perceptive  comments  concerning  this  and  the  consequent  need 
for  a  theory  of  errors  to  explicate  the  effects  of  poor  decision 
situation  structural  models  and  parameters  within  the  structure. 
A  hoped-for  achievement  is  a  sensitivitv-based  analysis  of  devia¬ 
tions  from  optimality  to  determine,  among  other  things,  the  role 
of  experience  in  decisionmaking  and  those  components  and 
principles  of  decisionmaking  which  can  be  usefully  and  meaning¬ 
fully  learned  from  experience  [47],  [94]— [97],  [115],  [116], 

Multiattribute  utility  models  based  on  the  expected  utility 
theory  of  von  Neumann  and  Morgenstcm  are  considerably  more 
complex  than  those  of  behavioral  decision  theory.  Often  there  are 
efforts  to  determine  existence  of  various  attribute  independence 
conditions  such  as  to  validate  use  of  a  linear  model  of  the  form  of 
(2)  or  a  multiplicative  model  of  the  form 

m  /i 

1  +HU(s,)=  II  [l  +h,IIu,(s,)].  2h,=  \.  (3) 

J= 1  ;=i 

The  foremost  proponents  of  this  approach  arc  Keeney  and  Raiffa 
[196].  There  are  manv  contributions  to  this  area  and  variations  of 
the  basic  approach  [231.  [29],  [75],  [93],  [127],  [23 1],  [277].  [278], 
[300],  [301],  [302],  [358],  [399].  It  is  proposed  exclusively  as  a 
normative  approach  and  has  been  successfully  used  for  a  variety 
of  applications  including  proposal  evaluation  [245],  [310],  siting 
power  plants  [197];  and  budgeting  and  planning  [52],  [191], 

Mean  Variance — There  are  a  number  of  models  and  associ¬ 
ated  decision  rules  based  upon  mean- variance  (EV)  models. 
Markowitz’s  portfolio  theory,  which  is  well  summarized  in  Libbv 
and  Fishburn  [214]  and  Baron  [26],  is  bascu  in  part  on  the 
assumption  of  a  quadratic  utility  function  •  , 

U(s)  =  a  +  fis  +  ys2  (4) 

where  the  same  states  are  assumed  invariant  over  all  alternatives 
such  that  we  have  a  quadratic  programming  problem  in  prioritiz¬ 
ing  alternatives  where 

n 

t:{c(a,)).=  2  />,<«, )i'h,) 

i  i 

=  a  +  ))/:'{  a.)  *-  y/.'{«:} 

=  a  -  fifi,  i-  Y (<V  “  g]  ) 

Coombs  [65],  [66|,  [185]  has  also  been  concerned  with  portfolio 
theory  and  assumes  an  optimum  risk  level  in  the  form  of  a  single 
peaked  risk  preference  function  for  every  expected  value  level. 
Gambles  of  equal  expected  value  are  judged  on  the  basis  of  lower 
variance  in  the  Markowitz’  portfolio  theory  and  on  the  basis  of 
deviation  from  optimum  risk  level  in  Coombs’  portfolio  theory. 
Stochastic  dominance  concepts  ( 1 24]  arc  especially  useful  in 


dealing  with  problems  in  the  mean-variance  models  of  portfolio 
theory.  Unfortunately  as  has  been  shown  by  a  number  of  authors 
[124],  the  results  from  using  mean- variance  portfolio  theory  are 
not  necessarily  consistent  with  results  obtained  from  expected 
utility  theory.  For  example,  if  the  outcomes  of  decision  u,  areSlO 
with  probability  0.5  and  $20  with  probability  0.5  and  the  out¬ 
come  of  decision  a,  is  $10  with  probability  1.0:  then  the  EV  rule 
(ji„i  =  $15.  au2  =  $5)  (gu2  =  $10.  <J„:  =  0)  is  indeterminate  in 
that  there  is  no  pareto  superior  or  dominance  alternative  in  an 
EV  sense.  Yet  any  reasonable  person  would  prefer  alternative  a, 
to  alternative  a2. 

Fishburn  [123]  has  considered  a  variation  of  the  mean- variance 
model  which  involves  concepts  based  upon  target  level  of  return 
or  aspiration  level  or  reference  level  to  define  the  risk  of  an 
alternative.  The  “risk"  of  alternative  a  is  determined  from  the 
probability  of  receiving  a  return  not  to  exceed  x.  denoted  F(.x), 
by 

R(a)  =  ['  (t  -  x)adF(x)  =  ['  ( t-x)“p(x)dx 

«  —  ac  »  —  x 


where  t  is  the  target  return,  a  is  a  nonnegative  parameter  that  is 
used  to  indicate  relative  importance  of  deviations  below  target 
return.  For  0  <  a  <  1  the  decisionmakers  primary  concern  is 
failure  to  achieve  the  target  with  little  regard  to  the  size  of  the 
deviation.  For  a  >  1  the  decisionmaker  is  very  concerned  with 
sizeable  deviations  from  target  and  relatively  unconcerned  with 
small  .deviations.  In  the  former  case  the  decisionmaker  is  risk 
seeking  for  losses  and  has  a  utility  function  that  is  convex  for 
losses.  In  the  latter  case  the  decisionmaker  is  risk  averse  for  losses 
and  has  a  utility  function  that  is  concave  for  losses. 

In  this  model  the  mean  return  from  an  alternative  and  its  risk 
arc  the  two  attributes  determining  preference.  This  model  thus 
appears  much  similar  to  the  standard  EV  model  in  that  a,  >  a ,  if 
and  only  if  ;t( a t )  »  g(a2)  and  R(a,)  <  R(a2)  with  at  least  one 
inequality  being  valid.  In  the  example  just  considered,  the  mean 
values  are  as  given  previously  and  the  risks  are 


*(«.) 


0, 

0.5 (r  -  10)". 

0.5( /  -  10)"  +  0.5 (t~  20)", 


t  10 
10«/«20 

20  «  t 


R(a:) 


0, 

('-  10)", 


t  «  10 

10  r 


Thus  we  see  that  the  risk  is  the  same,  that  is  zero,  if  /  ^  10  and  so 
we  prefer  a,.  The  risk  associated  with  a,  is  one  half  that  associ¬ 
ated  with  a2  if  the  target  return  is  between  $10  and  $20.  The  risk 
associated  with  tt,  is  less  than  that  associated  with  ci,  if  t  s*  20. 
And  so.  since  g ( a, )  >  g{  a2 ),  we  prefer  a,  regardless  of  the  target 
return.  Generally,  as  in  this  case,  Fishburn’s  below -target  model 
will  resolve  ambiguities  associated  with  the  standard  mean- 
variance  model.  The  decisionmaker  is  free  to  specify  a  and  t. 
Thus  this  represents  a  rather  useful  dominance  type  decision  rule. 
Extensions  of  this  rule  to  the  case  of  multiattributc  and  multiple 
objective  preferences  would  have  considerable  value. 

Suhicctive  Utility  Theon:  A  number  of  researchers  have  pro¬ 
posed  holistic  decision  rules  based  on  the  observation  lhat  peo¬ 
ple.  in  unaided  situations,  do  not  tvpicallv  perceive  (objective) 
probabilities  such  that  the  fundamental  probabilitv  property 
i  Pi  -  I  is  satisfied.  There  presently  exists  several  decision 
situation  models  based  upon  a  subjective  utility  theory  in  which 
probabilities  do  not  sum  to  one.  Among  these  arc  certainty 
equivalence  theory  due  to  Handa  j  1 44 [,  subjectively  weighted 
utility  theory  due  to  karmarkar  |I8S],  [189];  and  prospect  theory- 
due  to  Tverskv  and  Kahncman  [184],  [385],  There  have  been 
several  additional  studies  involving  prospect  theory  including 
those  of  Thaler  [371].  and  Hcrshev  and  Schoemakcr  [152],  [153], 
Some  of  the  foundations  (or  these  subjective  utility  theory  efforts 
can  be  found  in  the  early  work  of  Allais  [3]  who  was  among  the 
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first  to  note  that  the  normative  expected  utility  approach  of  von 
Neumann  and  Morgenstem.  and  the  subjective  expected  utility 
modifications,  did  not  necessarily  describe  actual  descriptive 
choice  behavior.  We  believe  that  these  studies  are  especially 
relevant  to  information  system  design  and  so  summarize  relevant 
features  from  these  effects  here. 

In  certainty  equivalence  theory  five  axioms  are  assumed.  We 
will  use  the  term  prospect  or  prospect  (s,  P)  to  mean  the  oppor¬ 
tunity  to  obtain  outcome  s  with  probability  P.  Simply  stated, 
these  are  as  follows. 

1)  Preferences  are  governed  only  by  utilities  and  outcomes. 
One  is  indifferent  between  a  nonsimple  prospect  and  an 
actuarially  identical  simple  prospect  with  a  single  event 
node. 

2)  Complete  ordering  of  prospects  is  possible  and  transitivity 
of  prospects  exists. 

3)  Continuity  exists  such  that  if  (sh  P,)  >  (s2.  P2)>^  (si<  ^ 3) 
then  there  exists  an  a  such  that  (s2,  P2)  ~  (ar,.  P,)  +  (Sj 
-  (JSj,  Py). 

4)  Independence  exists  such  that  if  (r,,  P, )  ~  (x„  1 ) V r ,  then 
(s,  P)  ~  (2x,,  1)  where  s  and  P  represent  vectors  of 
outcomes  and  probabilities  s ,  and  Pr 

5)  Enhanced  prospects  are  preferred  if  and  only  if  a  basic 
prospect  is  preferred.  Thus  P|)  **  (fir,,  P,)V/?  s*  0  if 
and  only  if  (st,  P,)  **  (s2,  P2)- 

These  axioms  are  sufficient  to  insure  that  the  subjective  utility 
function  of  alternative  a,,  C£(a,)  =  C£(s(a,),  P(a,)l  = 
U(s‘,  P'),  is  linear  in  s,  and  of  the  form 

U(s',p')  =  1  s\w{Pj)  =  wT(P')s:-  (5) 

;  =  l 

Axioms  1 ,  4,  and  5  incorporate  the  major  changes  from  the  von 
Neumann-Morgenstem  axioms.  It  appears  unduly  restrictive  to 
require  that  the  utility  function  be  linear  in  the  outcome  and  this 
is  reason  enough  to  warrant  the  development  of  a  more  robust 
theory. 

Fishbum  (1251.  however,  has  shown  that  certainty  equivalence 
theory  must  reduce  to  the  expected  value  model,  f/(s,  P)  —  Prs, 
2",xw(P))=  I.  This  occurs  because  of  the  requirement  that  one 
must  be  indifferent  between  a  nonsimple  prospect  and  an  actuari¬ 
ally  equivalent  simple  prospect.  To  insure  this  for  the  two  out¬ 
come  case,  for  the  general  actuarially  equivalent  two  outcome 
prospects  of  Fig.  5,  requires  that  h>(  P)  +  w(l  —  P)  =  l.3  This 
certainty  must  be  viewed  as  another  limitation  of  this  certainty 
equivalence  theorv  and  indicates  the  considerable  care  that  must 
be  exercised  in  modifying  the  basic  utility  theory  axioms. 

The  subjective  weighted  utility  model  yields  for  the  SIFT/  of 
alternative  a, 

StVU( a, )  =  £  h[P, (a, )](/[*, (a,)]  (6) 

7=1 


where  the  subjective  weighted  probabilities  are 

r  r  ,  ,t  .  AW\ 
w[  P,(  a  )j  -  — - 

2  /[P,(«)  1 

7=1 


Although  a  variety  of  probability  weighting  functions  are  possi¬ 
ble.  Karmarkar  (188),  (189)  proposes  use  of  a  log  normal  function 


1  For  (he  it  outcome  case  we  would  have  2'- 1**  (  P, )  —  I  and  wc  see  that 
the  only  general  »( Pt )  that  will  insure  this  is  h< P,)-Pr 


sa  se  "  t 


(a)  (b> 

Fig.  5.  Two  actuarially  equivalent  prospects. 


where  0  <  a  <  1.  This  transformation  of  probabilities  is  such  that 
large  probabilities  are  understated  and  small  probabilities  over¬ 
stated.  Karmarkar  emphasizes  that  the  probability  weight¬ 
ing  function  does  not  represent  a  probability  perception  phen¬ 
omenon  but  represents  a  bias  in  the  way  in  which  (objective) 
probabilities  are  descriptively  incorporated  into  the  evaluation, 
prioritization,  and  choicemaking  process.  In  this  model,  the  final 
weighted  probabilities  do  sum  to  one  in  accordance  with  the 
conventional  subjective  expected  utility  theory.  However,  the 
expression  for  any  normalized  weight  w(P;(a)]  is  actually  a 
function  of  the  value  of  all  other  probabilities  as  seen  in  (7).  The 
effects  of  this  confounding  of  influence  remain  to  be  investigated. 

The  considerably  more  sophisticated  prospect  theory  of 
Tversky  and  Kahneman  [184],  (3851.  contains  a  number  of  mod¬ 
ifications  to  expected  utility  theory.  Prospect  theory  consists  of 
an  editing  phase  involving  framing  of  contingencies,  alternatives, 
and  outcomes,  followed  by  an  evaluation  phase.  These  modify 
subjective  expected  utility  theory  such  as  to  enhance  unaided 
descriptive  realism  of  the  theory 

1)  In  the  editing  phase,  the  decision  situation  is  recast  into  a 
number  of  simpler  situations  in  order  to  make  the  evalua¬ 
tion  task  simpler  for  the  choicemaker.  The  tasks  in  editing 
are  very  much  dependent  on  the  contingency  situation  at 
hand  and  offer  possibilities  for  coding,  combining,  segregat¬ 
ing,  cancelling,  and  detection  of  dominance. 

2)  Value  functions  are  devoid  of  risk  attitude  and  are  unique 
only  up  to  positive  ratio  transformations. 

3)  Outcomes  are  expressed  as  positive  or  negative  deviations 
from  a  reference  or  nominal  outcome  which  is  assigned  a 
value  of  zero.  Thus  value  changes  represent  changes  in  asset 
position.  Positive  and  negative  values  are  treated  differently 
with  the  typical  value  function  being  an  S-shaped  curve  that 
is  convex  below  the  reference  point  and  concave  above  it. 
Displeasure  with  loss  is  typically  greater  than  pleasure 
associated  with  the  same  gain. 

4)  Probability  weights  w[P,(a))  reflect  an  uncertain  outcome 
contribution  to  the  attractiveness  of  a  prospect.  As  in  SIVU 
theory,  high  probabilities  are  underweighted  and  low  ones 
overweighted.  The  following  arc  among  the  properties  of  the 
probability  weighting  function. 

a)  True  at  extremes  te(0)  =  0,  w(l)  =  I 

b)  Subadditivc  at  low  P,  tv(oP)  >  aw(  P), 0  <  a 

c)  Overweighted  for  small  p.  w(  p)  >  p,  p  *  1 

d)  Underweighted  for  large  P.  »  ( P)  <  P.  P  0 

e)  Subccrtain  w( p )  +  w(  I  —  p )  <  1 

f)  Subproportional  h(oP)/h(P)  w{aPP)/»iPP).  0  < 

a.  ft,  «  1. 

5)  The  value  of  a  prospect  (s,  P)  ~  (s,.  P|)  +  (Jj.  P2 )  is  given 
by 

a)  F(.*.  P)  =  v(Si)  +  k( P,)[c(y|)  -  c<S:)l 
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for  strictly  positive  prospects  in  which  F,  +  F,  =  1  and 
s,  >  s2  >  0,  or  strictly  negative  prospects  in  which  F,  + 
P 2  =  l",  S,  <  S2  <  0. 

b)  F(j,  P)  =  w{P,)v(S,)  +  w{P2)v(s2)  (11) 

for  regular  prospects  which  are  prospects  that  are  neither 
strictly  positive  nor  strictly  negative  in  that  either  P{  +  P2 
#  I  and/or  uU,)  and  v(s2)  are  of  opposite  sign. 

In  no  sense  is  prospect  theory  posed  as  a  normative  theory  of 
how  people  should  make  decisions.  The  editing  or  framing  of 
contingencies,  alternative  acts,  and  outcomes  is  similar  to  the 
formulation  step  of  the  systems  process.  It  is  in  this  forming 
phase  that  the  contingency  task  structure  and  decision  situation 
model  are.  in  effect,  formed.  For  example,  in  a  population  of  one 
million  people  where  black  lung  disease  might  kill  two  thousand 
people,  possible  forms  are 

Form  1 — Alternative  a,  will  save  500  people  whereas  if  alter¬ 
native  a,  *s  adopted  there  is  a  0.25  probability  of 
saving  2000  people  and  a  0.75  probability  of  not 
saving  anyone. 

Form  2 — Alternative  a,  will  result  in  death  of  1500  people 
whereas  alternative  a4  will  result  in  a  0.25  probability 
that  no  one  will  die  and  a  0.75  probability  that  2000 
people  will  die. 

These  two  forms  are  really  the  same,  yet  many  people  will 
interpret  them  differently.  The  editing  or  forming  phase  of  pro¬ 
spect  theory  allows  different  interpretations  and  thus  makes 
provision  for  different  evaluation  of  results  in  terms  of  alternative 
formulations  of  the  same  issue. 

Prospect  theory  is  especially  able  to  cope  with  certainty  effects 
in  which  people  overweight  outcomes  considered  certain  com¬ 
pared  with  those  considered  only  highly  probable;  reflection 
effects  in  which  preferences  are  reversed  when  two  positively 
valued  outcomes  are  replaced  by  two  negatively  valued  outcomes; 
and  isolation  effects  in  which  people  disregard  ..immon  outcome 
components  shared  by  outcomes  and  focus  only  on  components 
that  distinguish  alternatives.  Kahneman  and  Tversky  have  estab¬ 
lished  an  axiomatic  basis  for  prospect  theory  (184J  for  the  two 
outcome  case. 

In  a  recent  study  involving  prospect  theory,  Hershey  and 
Schocmaker  [152]  question  the  generality  of  the  reflection  hy¬ 
pothesis  of  prospect  theory  which  states  that  asymmetric  prefer¬ 
ences  are  found  when  comparing  gain  prospects  with  loss  pro¬ 
spects.  They  introduce  four  types  of  reflectivity  depending  upon 
whether  subjects  choose  positive  prospect  (j,.  /*,)  or  the  noninfe¬ 
rior  prospect  ( s:,  P2 ),  and  whether  they  choose  negative  prospect 
(~J|,  P i)  or  (~s2,  P2).  Across-subject  and  within-subject  reflec¬ 
tivity  are  examined  in  terms  of  whether  subjects  do  or  do  not 
choose  and  do  or  do  not  switch  from  safe  to  risky  prospects. 
They  conclude  that  predictions  of  prospect  theory  concerning 
reflectivity  depend  upon  the  size  of  probabilities.  For  P  large 
enough  to  insure  underweighting  of  probabilities,  it  appears  that 
the  reflectivity  hypothesis  is  quite  valid.  For  smaller  values  of  P, 
reflectivity  is  neither  predicted  nor  excluded  from  the  results  of 
Hershey  and  Schocmaker. 

In  another  study  Hershey  and  Schocmaker  [1531  examine 
preferences  for  basic  insurance-loss  lotteries  and  show  that  risk 
taking  is  prevalent  in  the  domain  of  losses.  They  suggest  a  utility 
function  which  is  concave  for  low  losses  and  convex  for  larger 
ones.  Thev  indicate  a  context  effect  in  which  various  insurance 
formulations  lead  to  more  risk  averse  behavior  than  for  statisti¬ 
cally  equivalent  gambling  formulations.  Their  conclusion  that 
probabilities  and  outcomes  mav  be  of  less  guidance  in  influencing 
decision  behavior  as  uncertainties  concerning  their  magnitude 
increase,  strengthens  conjectures  concerning  the  influence  of  con¬ 
text  and  perceptions  of  decision  situation  structural  models  upon 
decision  results. 


Thaler  [371]  examines  a  number  of  the  tenets  of  prospect 
theory  with  generally  very  positive  confirming  results.  Additional 
comments  concerning  the  seminal  prospect  theory  appear  in  a 
previous  survey  in  these  transactions  [304]  including  the  observa¬ 
tion  that  a  number  of  the  results  of  prospect  theory,  which  are 
seemingly  at  variance  with  expected  utility  theory,  can  be  accom¬ 
modated  successfully  using  multiple  attribute  utility  theory. 
Extensions  of  prospect  theory  to  include  multiple  attribute 
preferences,  large  number  of  outcomes,  sequential  multistage 
decisionmaking,  risk  aversion  coefficients,  and  subjective  proba¬ 
bility  effects  would  do  much  to  enable  this  significant  develop¬ 
ment  to  be  of  even  greater  usefulness  in  explaining  complex 
positive  or  descriptive  decision  behavior.  This  might  well  be  of 
much  normative  use  as  well. 

Heuristic  Decision  Rules 

A  number  of  decision  rules  do  not  involve  comparisons  in  a 
true  holistic  fashion.  Rather  they  involve  comparisons  of  one 
alternative  with  another,  generally  within  a  restricted  alternative 
set  and  attribute  set  Within  the  heuristic  class  of  decision  rules 
we  may  distinguish  those  which  compare  alternatives  against 
some  standard  by  means  of  conjunctive  or  disjunctive  compari¬ 
sons,  those  which  compare  alternatives  across  attributes,  and 
those  which  make  comparisons  within  attributes.  Generally,  these 
rules  can  result,  when  improperly  applied,  in  intransitive  choices 
[289],  We  will  consider  several  rules  from  each  subcategory.  First 
we  will  discuss  two  noncompensatory  rules  [90]  that  are  often 
used  when  there  is  an  overabundance  of  data  present. 

Disjunctive — A  disjunctive  decision  rule  is  one  in  which  the 
decisionmaker  identifies  minimally  acceptable  value  standards 
for  each  relevant  attribute.  Alternatives  which  pass  the  critical 
standard  on  one  or  more  attributes  are  retained.  Alternatives 
which  fall  below  the  critical  standards  on  all  attributes  are 
eliminated.  A  single  alternative  is  accepted  when  the  critical 
standards  are  set  such  that  all  but  one  alternative  fail  to  exceed 
any  of  the  critical  standards  on  any  attributes.  Unlike  multiat¬ 
tribute  utility  theory  (MAUT)  rules,  where  poor  performance  on 
one  attribute  can  be  made  up  by  good  performance  on  other 
attributes  such  that  the  rule  is  compensatory,  a  disjunctive  deci¬ 
sion  rule  is  noncompensatory.  A  compensatory  approximation  to 
a  disjunctive  decision  rule  for  attributes  s ,  is 


where  m  represents  the  number  of  attributes  and  c,  is  the  critical 
value  on  the  ith  attribute.  If  V  is  greater  than  one,  the  alternative 
in  question  is  retained. 

Conjunctive— A  conjunctive  decision  rule  is  one  in  which 
minimally  acceptable  value  standards  for  each  relevant  attribute 
arc  identified.  Alternatives  arc  acceptable  if  they  exceed  all 
minimum  standards.  They  arc  rejected  if  thev  fail  to  exceed  anv 
minimum  standard.  The  critical  values  for  disjunctive  and  con¬ 
junctive  rules  arc  generally  different.  A  compensatory  approxima¬ 
tion  to  the  noncompensatory  conjunctive  decision  rule  is 


An  alternative  is  retained  if  the  corresponding  utility  U  is  above  a 
threshold  which  is  set  just  slightly  below  I.  These  approximations 
for  the  disjunctive  and  conjunctive  rules  become  noncompensa¬ 
tory  as  «,  approaches  infinity. 

By  iterating  through  the  conjunctive  acceptance  and  disjunc¬ 
tive  rejection  rule  several  limes  with  adjustable  critical  values  or 
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aspiration  levels,  these  rules  become,  in  effect,  forms  of  satisficing 
rules. 

Dominance  models  and  additive  difference  models  are  two 
examples  of  models  which  lead  to  decision  rules  involving  com¬ 
parison  across  some,  but  not  necessarily  all,  attributes.  No 
minimum  standard  of  performance  on  attributes,  that  is  to  say 
minimum  aspects,  are  identified. 

Dominance — A  dominance  decision  rule  is  one  which  chooses 
alternative  a,  over  a,  if  a,  is  better  than  a:  on  at  least  one  aspect 
and  not  worse  than  a,  on  any  other  aspect.  An  aspect  is  the  score 
of  a  specific  attention  on  a  specific  attribute.  There  are  a  number 
of  applications  of  dominance  theory,  including  stochastic  domi¬ 
nance.  to  decisionmaking  situations  [33),  [54).  [75),  (124),  [358], 
(399). 

Additive  difference — In  an  additive  difference  rule  (382)— (385). 
a  binary  choice  is  made  between  alternatives  a,  and  a,.  Dif¬ 
ferences  are  considered  between  values  for  a,  and  a:  on  each 
relevant  attribute.  Differences  of  the  form  Ufa,)  -  Ufa ,)  arc 
computed.  Each  of  the  differences  is  weighted  in  proportion  to 
the  importance  of  the  differences  between  alternatives  on  the 
various  attributes.  The  resulting  weight  is  f\Ufa,)  -  t/,(a;)). 
Alternative  1  is  preferred  to  alternative  2  only  if 

n 

2  f, [Ufa,)  -  Ufa,)]  >0. 

i=  i 

This  is  a  compensatory  rule  and  can  be  used  to  compare  any 
number  of  alternatives  merely  bv  retaining  the  winner  in  each 
comparison  [272|.  Only  if  the  functions  f  are  linear  will  the 
additive  difference  rule  necessarily  lead  to  transitive  choices. 

A  third  important  subcategorization  involves  comparison 
within  attributes.  There  are  a  variety  of  lexicographic  procedures 
[121)  and  the  elimination  by  aspects  rule  (381),  [382)  which 
explicitly  involve  comparison  of  alternatives  on  one,  or  at  most  a 
few.  attributes. 

lexicographic  Decision  Rale:  This  rule  prescribes  a  choice  of 
the  alternative  which  is  most  attractive  on  the  most  important 
attribute.  If  two  aspects  on  this  attribute  are  equally  attractive, 
the  decision  will  be  based  upon  the  most  attractive  aspect  on  the 
attribute  next  in  order  of  importance,  etc. 

Minimum  Difference  Lexicographic  Rule:  This  rule  is  much  like 
the  lexicographic  rule,  with  the  additional  assumption  that  for 
each  attribute  there  is  a  minimum  acceptable  difference  2,  of 
alternative  scores.  Thus,  only  differences  greater  than  2,  between 
the  attractiveness  values  of  two  alternatives  may  determine  a 
decision.  If  the  difference  on  the  most  important  attribute  is  less 
than  4 , .  then  the  attribute  next  in  the  lexicographic  order  is 
considered.  The  lexicographic  semiordcr  rule  is  a  special  case  of 
this  decision  rule  where  2,  is  defined  only  for  the  most  important 
attribute.  For  all  other  attributes  2,  =  0.  This  procedure  mav 
easily  be  extended  to  cases  where  the  2  are  defined  for  the  two 
most  important  aspects.  This  rule  is  often  used  in  situations 
where  information  about  attributes  are  missing  as  a  result  of 
imperfect  discrimination  among  alternatives  on  a  given  attribute 
or  of  unreliability  of  available  information.  In  general  this  rule 
leads  to  intransitive  choices  when  there  are  more  than  two 
alternatives.  It  may  even  lead  to  agenda  dependent  results  for  the 
case  where  there  are  onlv  three  alternatives.  One  should  be 
especially  careful  to  examine  relations  used  for  ordering  alterna¬ 
tives  to  attempt  to  detect  use  of  heuristics  such  as  this,  especially 
if  concepts  such  as  transitivity  are  used,  perhaps  lnterentiallv.  to 
determine  partial  orderings.  This  suggests  the  need  for  special 
care  when  attempting  to  use  transitivity  concepts  to  infer  ordinal 
preferences.  The  resulting  failure  to  seek  discontinuing  informa¬ 
tion  mav  well  create  structural  preference  illusions. 

Einhorn  (96),  (97)  first  uses  the  term  "outcome  irrelevant 
learning  structure"  to  desenbe  processes  which  used  deficient 
heuristics,  and  which  then  reinforces  poor  choices  through  experi¬ 
ences  involving  feedback  and  lack  of  discomfirnnng  evidence. 


These  outcome  irrelevant  learning  structures  (OILS)  may  result 
either  from  unaided  judgment  processes  or  from  poorly  conceived 
or  possibly  well  conceived  but  improperly  utilized,  and  therefore 
irrelevant,  systemic  methods  or  processes. 

The  Maximicing  Number  of  Attributes  in  Greater  Attractiveness 
Rule:  This  rule  prescribes  a  choice  of  the  alternative  that  has  the 
greater  number  of  favorable  attributes.  Specifically  the  rule  re¬ 
quires  that  the  aspect  of  a  decision  alternative  must  be  classified 
for  each  attribute  as  better,  equal,  or  worse  than  the  attractive¬ 
ness  of  the  other  alternative  on  that  attribute.  The  preferred 
alternative  will  be  that  which  has  the  greatest  number  of  favora¬ 
ble  classifications. 

Elimination  by  Aspects:  In  this  rule  [288],  [381)  attributes  are 
assumed  to  have  different  importance  weights.  An  attribute  is 
selected  with  which  to  compare  alternatives  with  a  probability 
that  is  proportional  to  its  weight.  Alternatives  which  do  not  have 
attribute  scores  above  some  aspiration  or  critical  level  are 
eliminated.  A  second  attribute  is  selected  with  probability  pro¬ 
portional  to  its  weight  and  evaluation  by  elimination  continues. 
The  elimination  by  aspects  model  is  thus  seen  to  be  a  lexico¬ 
graphic  rule  in  which  decision- forming  attributes  are  picked 
according  to  a  p  '■babilistic  mechanism. 

Wliolis.ic  Decision  Rules 

It  is  not  possible  to  provide  anywhere  near  a  complete  listing 
or  discussion  of  the  many  possible  wholistic  decision  rules.  Three 
of  these  wholistic  judgment  processes  occur  perhaps  more  fre¬ 
quently  than  others:  standard  operating  procedures,  intuitive 
affect,  and  reasoning  by  analogy. 

Standard  Operating  Procedures:  Standard  operating  procedures 
may  result  from  the  application  of  holistic  or  heuristic  proce¬ 
dures.  or  other  wholistic  judgment  approaches.  A  standard  oper¬ 
ating  procedure  is  essentially  what  the  name  implies,  a  set  of 
experience-based  guides  to  behavior  which  arc  typically  used 
without  resort  to  the  underlying  rationale  which  led  to  the 
procedure  Often  standard  operating  procedures  arc  formulated 
by  one  person  or  group  and  then  implemented  by  another  person 
or  group.  Sometimes  they  involve  habit  or  folk  custom,  such  as 
“drink  white  wine  with  fish." 

Often  user’s  guides  and  operating  manuals  are  written  in 
attempts  to  standardize  operating  procedures  for  performance. 
The  greatest  value  of  these  procedures  is  as  a  checklist,  reminder, 
or  options,  profile  of  attributes  to  look  for.  judgments  to  make  or 
activities  to  select  or  perform.  A  fundamental  often  occurring 
difficulty  is  that  an  expert  may  be  able  to  use  a  checklist  or 
profile  of  options  as  a  guide  to  performance  based  upon  the 
abilitv  of  the  expert  to  quickly  recognize  the  features  inherent  in 
the  situation.  Lack  of  training  and  experience  will  often  make  it 
not  possible  for  ihc  novice  to  utilize  this  capacity  for  task  need 
recognition.  Klein  and  Weitzenfeld  [202).  [230)  pose  that  the  lack 
of  training  and  experience  inherent  in  the  novice,  the  associated 
lack  of  ability  to  recognize  contextual  relations  and  analogous 
situations,  and  the  inability  of  guides  to  be  able  to  teach  this 
ability  are  all  fundamental  impediments  to  the  use  of  mans 
standard  operating  procedure  type  guides  to  judgment  and  per¬ 
formance 

Intuitive  Aflecl 

A  person  who  makes  lodgments  based  on  intuitive  affect 
lypicallv  takes  in  information  bv  looking  at  the  “whole"  of  a 
situation  rather  than  bv  disaggregating  the  situation  into  its 
component  parts  and  acquiring  data  on  the  parts  Valuation  is 
lypicallv  based  on  an  attempt  to  determine  whether  alternatives 
are  pleasant  or  unpleasant,  likeable  or  unlikeable.  good  or  had 
for  individuals.  It  stressed  the  uniqueness  of  personalistic  value 
judgments,  /aionc  (41 1 1  presents  a  verv  useful  discussion  of 
affect  or  feeling  as  postcognilive  activity. 


656 


IEEE  TRANSACTIONS  ON  SYSTEMS.  MAN.  AND  CYBERNETICS.  VOl .  SMC- II.  NO.  6.  SEPTEMBER  1981 


Reasoning  by  Analog)' 

Many  philosophers  of  science  claim  reasoning  by  analogy  [55], 
[130],  [360]  is  the  basis  of  hypothesis  generation.  It  is  funda¬ 
mentally  different  than  deductive  inference  or  inductive  infer¬ 
ence-based  reasoning.  In  analogic  reasoning  we  use  analogies, 
prototypes,  or  other  paradigms  with  which  we  are  familiar  to 
guide  us  in  new  tasks.  These  exemplars  encourage  recognition  in 
a  present  situation  in  terms  of  experientially  based  knowledge. 

Doubtlessly  analogic  reasoning,  as  well  as  reasoning  by  intui¬ 
tive  affect  and  standard  operating  procedures,  are  each  heavily 
influenced  by  the  contingency  structure  of  the  task  at  hand  and 
the  environment.  These  are  the  judgment  processes  used  by  many 
in  reaching  decisions.  We  will  comment  further  in  Sections  V  and 
VI  upon  wholistic judgment  and  its  role  [81],  [82],  [98],  [1 16]— [  1 19], 
[202],  [203]  in  choicemaking. 

In  this  section  we  have  examined  a  number  of  decision  rules. 
We  have  discussed  holistic,  heuristic,  and  wholistic  rules.  The 
holistic  models  or  rules  arc  generally  substantive  and  not  neces¬ 
sarily  process  models.  They  may  be  prescriptive  or  descriptive  in 
intent  and  use.  The  heuristic  and  wholistic  models  are  more 
process  oriented  than  the  heuristic  models.  In  unaided  situations 
people  generally  do  not  have  the  cognitive  stamina  to  utilize  the 
holistic  rules  or  may  not  sense  a  need  for  them  even  if  they  could 
utilize  them.  A  variety  of  contemporary  research  [273]-[275]  has 
presented  the  strongest  of  evidence  that  choice  of  decision  rules  is 
very  task  dependent  and  actual  choices  may  vary  appreciably 
across  different  interpretations  of  the  same  decision  situations. 
Preference  reversals  have  even  been  noted  with  translation  of 
gambles  and  target  return,  reference  point,  or  aspiration  level 
effects.  Phenomena  such  as  these  have  recently  been  studied  [274] 
and  shown  to  be  potentially  explainable  by  a  descriptive  mode!  of 
risky  choice  due  to  Fishburn  [123]  and  by  prospect  theory. 

We  note  that  people  use  different  decision  rules  and  models  at 
different  phases  of  a  decision  process  as  a  function  of  a  number 
of  influencing  variables,  such  as  education,  experience,  motiva¬ 
tion,  familiarity  with  the  environment,  and  above  all.  stress. 
Etzioni  [103],  [104]  has  proposed  a  mixed  scanning  model  of 
decisionmaking  that  forms  the  basis  for  some  current  research  in 
information  systems  for  planning  and  decision  support  [75],  [76], 
[245],  [399],  there  are  a  number  of  contemporary  efforts  and 
approaches  that  support  the  design  of  systemic  aids  that  will  be 
more  responsive  to  decisionmaker  requirements.  Especially  im¬ 
portant  in  this  regard  are  the  efforts  of  Einhom.  Kleinmuntz.  and 
Kleinmuntz  [95]:  Hogarth  and  Makridakis  [161],  Huber  [168], 
Jungerman  [181],  Kleinmutz  and  Kleinmutz  [204],  Lad  [208], 
Libby  [213],  Montgomery  and  Svenson  [256],  Payne  (27  ]  ]— [275], 
Rouse  [299],  Svenson  [364],  [365],  Thomgate  [372],  Toda  [373]- 
[375 ].  Tvcrskv  and  Sattagh  [384],  Twenev  et  al.  [387],  Vick  [392], 
[393];  Wallsten  [395],  [396],  Efforts  which  concern  the  integration 
of  de>eripti\e  and  prescriptive  components  of  decisionmaking 
[142],  [307],  [322],  [323]:  efforts  which  concern  determination  of 
cognitive  choice  models  in  realistic  settings  [22],  [88],  [157],  [158], 
[314],  [325j:  efforts  which  involve  formulation  and  structuring  of 
decision  situations  [I],  |247],  [248],  [255],  [265],  [286],  (287|.  [300], 
[301 1 .  |3()2],  [353],  |397|:  and  efforts  which  involve  the  cognitive 
effort  involved  in  decisionmaking  [180],  [32S|.  may  offer  much 
promise  as  well. 

V.  CuMiNOi  m  y  Task  Siri  c  ii'Rh  Moul  ts 

The  designer  of  information  svstems  for  planning  and  decision 
support  must  be  concerned  both  with  normative  models  of  deci¬ 
sion  and  choice  processes  and  with  descriptive  models  of  how 
people  perform,  and  can  perform,  in  given  situations.  Thus  our 
discussions  of  information  processing  and  decision  or  evaluation 
rule  selection  in  the  previous  two  sections  take  on  particular 
meaning  in  that  thev  comment  on  the  wide  variety  of  possible 
behaviors.  We  will  he  especially  concerned,  in  this  section,  with 


describing  cognitive  processes  as  they  are  influenced  by  the 
contingency  structural  elements  of  task,  environment  and  the 
human  problem  solver’s  experience  with  these.  There  have  been  a 
limited  number  of  efforts  to  describe  these  such  as  those  by  Allais 
and  Hagen  [3],  Beach  and  Mitchell  [32],  Borgida  and  Nisbett  [42). 
Broadbent  (49).  Bunn  [53],  Carrol  [56],  Dreyfus  and  Dreyfus 
[82],  Einhom  [96],  [97],  Einhom  and  Hogarth  [98],  Harsanvi 
[147],  Hauser  [149],  Howell  and  Fleishman  [165],  Huber  [168], 
Janis  and  Mann  [176],  [177],  Jungerman  [182).  Klein  [202],  [203], 
Kleinmutz  and  Kleinmutz  [204],  Kunruether  and  Schoemakcr 
[207],  MacKinnon  and  Wearing  [233],  Montgomery  and  Svenson 
[256],  Payne  [272],  [275],  Sage  [308],  Simon  [338],  [340],  [341], 
[343],  Soelberg  [353],  and  Wallsten  [395],  [396],  This  is  an  area  in 
which  additional  research  could  pay  major  dividends  in  ulti¬ 
mately  increasing  the  effectiveness  of  information  systems  in 
coping  with  the  contingency  task  structure  variables  in  planning 
and  decision  support. 

The  contingency  task  structure  model  we  first  describe  is 
related  to  Piaget's  theory  of  intellectual  development  [43],  [126], 
J13I],  [205],  [262).  [362],  After  a  description  of  this  model  [308]  we 
indicate  implications  for  information  system  design  and  the  rela¬ 
tionship  of  this  model  to  models  that  have  been  proposed  by 
others. 

Insights  into  the  nature  of  cognitive  development  and  insights 
into  a  conceptual  model  of  cognitive  activity  is  contained  in  the 
works  of  Piaget,  the  founder  of  "genetic  epistemology.”  Accord¬ 
ing  to  Piaget,  there  are  four  stages  of  intellectual  development: 

1)  sensory  motor 

2)  preoperational 

3)  concrete  operational 

4)  formal  operational. 

The  last  twe  of  these  are  of  particular  importance  to  our  efforts 
here.  In  the  writings  ol  Piaget,  intellectual  development  is  seen  as 
a  function  of  four  variables: 

1)  maturation 

2)  experience 

3)  education 

4)  self  regulation— a  process  of  mental  struggle  with  discom¬ 
forting  information  until  identification  of  a  satisfactory 
mental  construction  allows  intellectual  growth  or  learning. 

In  Piaget’s  model  of  intellectual  development  concrete  opera¬ 
tional  thinkers  can  deal  logically  with  empirical  data,  manipulate 
symbols,  and  organize  facts  towards  the  solution  of  well  struc¬ 
tured  and  personally  familiar  problems.  Formal  operational 
thinkers  can  cope  in  this  fashion  also.  A  major  difference,  how¬ 
ever,  is  that  those  concrete  thinkers  who  are  not  also  capable  of 
formal  thought  lack  the  capacity  to  reason  hypothetically  and  to 
consider  the  effect  of  different  variables  or  possibilities  ou.side  of 
personal  experience.  Concrete  operational  thinkers,  for  instance, 
will  often  have  difficulty  in  responding  “true"  or  "false"  to  the 
statement,  "six  is  not  equal  to  three  plus  four.”  As  another 
example:  “A  card  has  a  number  on  one  side  and  a  letter  on  the 
other:  test  the  hypothesis  that  a  card  with  a  vowel  on  one  side 
will  have  an  even  number  on  the  other  side."  Concrete  opera¬ 
tional  thinkers  will  have  difficulty  selecting  cards  for  bottom  side 
examination  if  the  top  sides  of  four  cards  are  a,  b.  2.  3.  However, 
failure  to  pick  the  cards  with  “a"  and  3  on  top  may  not  indicate 
inability  as  a  formal  operational  thinker  but.  rather,  failure  to 
properly  diagnose  the  task  and  determine  the  need  for  formal 
operational  thought. 

We  wish  to  develop  a  model  of  higher  order  cognitive  process¬ 
ing  that  describes  the  mature  adult  decisionmaker.  Such  a  de¬ 
cisionmaker  will  typically  be  capable  of  both  formal  and  concrete 
operational  thought.  As  we  will  argue,  selection  of  a  formal  or 
concrete  cognitive  process  will  depend  upon  the  decisionmaker’s 
diagnosis  of  need  with  respect  to  a  particular  task.  That  need  will 
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depend  upon  a  decisionmaker's  maturity,  experience,  and  educa¬ 
tion  with  respect  to  a  particular  problem.  Each  of  these  influence 
cognitive  strain  or  stress,  a  subject  that  will  be  discussed  later  in 
this  section.  Ordinarily,  a  decisionmaker  will  prefer  a  concrete 
operational  thought  process  and  will  make  use  of  a  formal 
operational  thought  process  only  when  concrete  operational 
thought  is  perceived  inappropriate.  In  general,  a  concrete  opera¬ 
tional  thought  process  involves  less  stress  and  may  well  involve 
repetitive  and  previously  learned  behavioral  patterns.  Familiarity 
and  experience,  with  the  issue  at  hand  or  with  issues  perceived  to 
be  similar  or  analogous,  play  a  vital  role  in  concrete  operational 
thought.  In  novel  situations,  which  are  unstructured  and  where 
new  learning  is  required,  formal  operational  thought  is  typically 
more  appropriate  than  concrete  operational  thought. 

We  see.  in  the  foregoing  discussion,  the  dominant  role  of  the 
contingency  task  structure  in  guiding  problem  solving  efforts.  In 
concrete  operational  thought,  people  use  concepts  which 

1 )  are  drawn  directly  from  their  personal  experiences. 

2)  involve  elementary  classification  and  generalization  con¬ 
cerning  tangible  and  familiar  objects, 

3)  involve  direct  cause  and  effect  relationships,  typically  in 
simple  two-variable  situations: 

4)  can  be  taught  or  understood  by  analogy,  algorithms,  affect, 
standard  operating  policy,  or  recipe;  and  which 

5)  are  “closed"  in  the  sense  of  not  demanding  exploration  of 
possibilities  outside  the  known  environment  of  the  person 
and  stated  data. 

In  formal  operational  thought,  people  use  concepts  which  may 

1)  be  imagined,  hypothetical,  based  on  alternative  scenarios, 
and/or  which  may  be  contrary  to  fact; 

2)  be  "open  ended"  in  the  sense  of  requiring  speculation  about 
unstated  possibilities. 

3)  require  deductive  reasoning  using  unverified  and  perhaps 
flawed  hypotheses. 

4)  require  definition  by  means  of  other  concepts  or  abstrac¬ 
tions  that  may  have  little  or  no  obvious  correlation  with 
contemporary  reality,  and  which  may 

5)  require  the  identification  and  structuring  of  intermediate 
concepts  not  initially  specified. 


Formal  operational  thought  involves  three  principal  stages: 

1)  reversal  of  realities  and  possibilities 

2)  hvpothetico-deductive  reasoning 

3)  operations  on  operations 

as  shown  in  Fig.  6.  These  are  accomplished  through  reflective 
observation,  abstract  conceptualization,  and  the  testing  of  the 
resulting  concept  implications  in  new  situations.  It  is  in  this  wav 
that  the  divergence  produced  by  discomforting  new  experiences 
allows  the  learning  of  new  developments  and  concepts  to  be 
“stored”  in  memory  as  part  of  one's  concrete  operational  experi¬ 
ences. 

A  number  of  the  cognitive  style  investigations  discussed  in 
Section  II  have  concluded  that  “abstract"  decisionmakers  are 
more  information  oriented  and  would  typically  process  much 
information  in  complex  decision  environments.  "Concrete”  de¬ 
cisionmakers,  on  the  other  hand,  could  be  expected  to  reach  an 
information  overloaded  state  at  lower  levels  of  environmental 
complexity;  hence  they  would  tend  to  process  less  information 
than  would  the  abstract  decisionmaker.  Some  models  of  cognitive 
style  are  based  on  the  assumption  that  “concrete”  decisionmakers 
need  more  information  to  arrive  at  a  decision  than  do  “abstract" 
decisionmakers,  suggesting  that  “concrete"  decisionmakers  do 
not  give  existing  information  its  full  worth  and  more  arc  prone  to 
fits  of  skepticism  than  "abstract"  decisionmakers.  At  first  glance, 
cognitive  style  models  such  as  the  one  suggested  here  appear  to 
run  in  parallel  to  Piaget’s  concepts  of  concrete  operational  and 
formal  operational  thought.  But  there  are  very  important  and 
very  significant  differences.  These  are  explicable  through  the 
contingency  task  structure  and  concept  of  task,  environment,  and 
decisionmaker;  a  concept  that  appears,  with  some  notable  excep¬ 
tions.  missing  in  much  of  the  existing  cognitive  style  research 
cited  in  Section  II. 

The  concrete  operational  thinker  does  not  necessarily  have 
limited  abilities  to  process  or  integrate  information,  and  the 
“formal”  operational  thinker  is  not  necessarily  capable  of  “ab¬ 
stract"  thought  in  the  specific  contingency  situation  at  hand.  The 
formal  thinker  is  neither  necessarily  able  to  process  information 
which  encompasses  more  complexity  nor  better  able  to  cope  with 
uncertainty  and  disjointedness  in  the  decision  environment  than 
is  one  who  uses  concrete  operational  thought  in  a  given  decision 
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situation.  Our  contingency  task  structural  model  for  the  mature, 
perhaps  expert,  adult  decisionmaker  is  one  in  which  the  de¬ 
cisionmaker  may  use  formal  or  concrete  operational  thought 
based  primarily  on  diagnosis  of  the  contingency  structure  of  the 
decision  situation,  and  the  stress  that  is  perceived  to  be  associ¬ 
ated  with  the  decision  situation.  This  election  of  a  formal  or 
concrete  operational  mode  of  thought  may  be  appropriate  or 
inappropriate. 

Systemic  process  design  must  be  responsive  to  the  observation 
that  there  are  two  fundamentally  different  thought  or  cognition 
processes.  These  are  often  associated  with  different  halves  of  the 
brain  (381.  [67],  (120),  [246-248],  (254),  [410],  One  type  of  thought 
process  is  described  by  the  adjectives  verbal,  logical,  sequenced, 
thinking,  and  analytical:  whereas  the  second  is  described  as 
nonverbal,  intuitive,  wholistic.  feeling,  and  heuristic.  The  verbal 
process  is  typically  viewed  as  superior  in  engineering  and  natural 
science.  But  this  viewpoint  on  the  nature  of  thought  appears 
wrong  and  should  be  discouraged  as  positively  harmful.  For  the 
two  processes  are  complementary  and  compatible.  They  are  not 
competitive  and  incompatible  in  any  meaningful  wav.  One 
thought  process  may  be  deficient,  in  fact,  if  it  is  not  supported  by 
the  other.  The  nonverbal  supports  the  verbal  by  suggesting  ideas, 
alternatives,  etc.  The  verbal  supports  the  nonverbal  by  ex¬ 
pressing,  structuring,  analyzing,  and  validating  the  creative  ideas 
that  occur  in  the  nonverbal  process.  An  appropriate  planning  and 
decision  support  process  must  provide  for  verbal  and  nonverbal 
support.  An  appropriate  planning  and  decision  support  process 
must  be  tolerant  and  supportive  of  a  decisionmaker's  cognitive 
(thought)  processes.  These  will  typically  vary  across  individuals 
and  within  the  same  individual  as  a  function  of  the  environment, 
the  individual's  previous  experience  with  the  environment,  and 
those  associated  factors  which  introduce  varying  amounts  of 
stress.  Thus  a  contingency  task  structural  view  of  individuals  and 
organizations  in  decision  situations  is  needed  as  contrasted  with  a 
stereotypical  view  in  which  individuals  are  assumed  to  process 
fixed,  static,  and  unchanging  cognitive  characteristics  which  are 
uninfluenced  by  environmental  considerations. 

This  view  will  encourage  us  not  only  to  consider  the  evolution 
of  future  events  over  time  as  inherently  probabilistic,  but  also  to 
consider  value  change  over  time.  It  is  especially  important  that 
we  consider  values  as  containing  noncommensurate.  ambiguous, 
and  uncertain  components,  rather  than  as  being  absolute,  con¬ 
sistent.  precise,  and  exogenous  with  respect  to  choice  [236],  [238], 

Typically  we  learn  from  experience  and  adopt  various  decision 
rules  in  the  form  of  cognitive  heuristics  based  upon  this  experi¬ 
ence.  The  strength  of  belief  that  we  have  in  the  usefulness  of 
heuristics  is  often  based  on  reinforcement  through  feedback. 
Einhorn  [96],  [97]  has  described  several  supporting  illustrations  of 
this.  As  we  have  indicated  in  Section  IV.  The  use  of  various  types 
of  lexicographic  semiorders  often  lead  to  intransitive  choices 
which  are  often  not  recognized  as  intransitive.  We  often  define 
issues  by  content  rather  than  structure  and  convince  ourselves  to 
like  what  we  get  from  a  decision.  As  a  consequence  we  find  it 
hard  to  separate  decisions  from  outcomes  in  retrospective  evalua¬ 
tions  of  our  judgments.  Much  of  this  is  probably  due  to  changing 
our  attitudes  and  our  perceptions  in  a  very  selective  wav  without 
being  aware  of  the  change  and  to  changing  our  forecasts,  retro¬ 
spectively.  to  correspond  to  events  that  have  occurred  without 
recognizing  this  change  [  1 1 7|-[  1 19]  Thus  we  adopt  a  hindsight  or 
"knew  it  all  along"'  bias  influenced  by  a  variety  of  highly  selective 
perceptions  of  reality. 

We  are  most  likely  to  have  coherent  value  preferences  and  are 
able  to  develop  and  utilize  appropriate  evaluation  heuristics  in 
well-structured  situations  with  which  we  arc  familiar.  Learning  by 
trial  and  error  and  development  of  judgment  based  on  either 
reasoning  by  analogy,  standard  operating  procedures,  or  organi¬ 
zational  rules  typically  results  from  these  “concrete  operational"' 
situations  and  experiences.  Long  standing  use  of  these  “rules" 
results  in  purely  affective  judgment  and  decision  responses.  In  a 


familiar  and  simple  world,  a  “concrete  operational"  world,  these 
judgment  guides  and  judgment  heuristics  might  well  be.  and  in 
fact  often  arc.  quite  acceptable.  In  a  changing  and  uncertain 
environment,  an  environment  that  is  different  from  the  one  with 
which  we  are  familiar,  we  may  well  err  considerably  by  using 
these  concrete  operational  world  appropriate  judgment  heuristics. 
If  we  do  not  have  a  developed  set  of  coherent  values  relative  to  a 
changing  environment,  we  may  respond  affectively  with  the  first 
alternative  option  that  comes  to  mind.  We  may  well  adopt 
postdecision  behavior  such  as  to  support  and  maintain  a  chosen 
response  and  employ  cognitive  biases  and  cognitive  heuristics  to 
justify  this  potentially  ill-chosen  response.  Tnis  results  in  an 
affective  response  appropriate  for  a  “concrete  operational”  situa¬ 
tion  when  an  analytical  response,  appropriate  for  a  “formal 
operational"  situation,  is  needed.  In  the  Janis  and  Mann  [177] 
terminology  we  adopt  a  coping  pattern  based  on  unconflicted 
adherence  or  unconflicted  change  whereas  vigilance  is  called  for. 

A  serious  problem  in  practice  is  that  we  get  used  to  very  simple 
heuristics  that  are  appropriate  for  “concrete  operational"  situa¬ 
tions  in  a  familiar  world  and  we  continue  to  use  them  in  “formal 
operational”  situations  in  an  unfamiliar  world  in  which  they  may 
be  very  inappropriate.  A  typical  heuristic  is  incrementalism:  “Go 
ahead  and  crowd  one  more  beast  into  the  commons."  Such  a 
heuristic  may  be  appropriate  in  the  familiar  situation  our  for¬ 
bears  encountered  in  a  new  unexplored  continent.  But  the  social 
traps"  produced  by  such  judgmental  heuristics  in  a  now  crowded 
environment  may  be  inappropriate.  There  are  numerous  contem¬ 
porary  issues  to  support  this  assertion. 

Styles  or  modes  of  information  processing,  which  includes 
information  acquisition  and  information  analysis,  are  of  much 
importance  in  the  design  of  information  systems  for  interpreta¬ 
tion  of  the  impacts  of  proposed  policy.  Information  acquisition 
refers  to  the  perceptual  process  by  which  the  mind  organizes  the 
verbal  and  visual  stimuli  that  it  encounters.  As  indicated  in 
Section  II.  McKennev  and  Keen  [242]  discuss  two  modes  of 
information  acquisition,  a  preceptive  mode  and  a  receptive  mode. 
We  essentially  utilize  these  modes  for  our  model  of  information 
acquisition  and  analysis. 

a)  In  preceptive  acquisition  and  analysis,  individuals  bring 
existing  experiential  concepts  and  precepts  to  bear  to  filter 
data.  They  focus  on  structural  relations  between  items  and 
look  for  deviations  from  their  expectations.  They  then  use 
formal  precepts  as  cues  for  acquisition,  analysis,  and  associ¬ 
ated  structuring  of  data. 

b)  In  receptive  acquisition  and  analysis,  individuals  focus  on 
contextual  detail  rather  than  presumed  structural  relation¬ 
ships.  They  infer  structure  and  impacts  from  direct  and 
detailed  examination  of  information,  generally  including 
potentially  discomfirming  information,  rather  than  from 
fitting  it  to  their  precepts. 

There  is  nothing  inherently  good  or  bad  in  either  mode  of 
information  acquisition,  analysis,  and  associated  structuring.  The 
same  individual  may  use  different  modes  as  a  function  of  con¬ 
tingency  task  structure.  Most  people  will  have  preferences  for  one 
mode  or  the  other  in  a  particular  situation,  depending  upon  their 
diagnosis  of  the  contingency  task  structure  and  perceived  needs 
to  accomplish  effective  information  interpretation  and  associated 
decisionmaking.  It  is  our  hypothesis  that  cognitive  biases  often 
arise,  or  are  initiated,  by  use  of  a  situationallv  incorrect  mode  of 
information  acquisition  and  structuring.  To  use  preceptive 
acquisition  when  receptive  acquisition  is  more  appropriate  would 
appear  to  invite  one  or  more  of  the  many  biases  associated  with 
selective  perception.  To  use  receptive  acquisition  w  hen  preceptive 
acquisition  is  appropriate  would  appear  to  introduce  much  stress 
associated  with  the  low  likelihood  of  being  able  to  resole e  an 
issue  in  the  time  available. 

Information  evaluation  and  interpretation  refers  to  the  deci¬ 
sion  rule  portion  of  the  problem  solution.  We  advocate  a  model 
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Fig.  7.  Conceptualization  of  problem  solving  styles. 


based  on  the  use  of  the  Piaget  theory  of  concrete  and  formal 
operational  thinking  as  a  useful  precept  for  information  evalua¬ 
tion  and  interpretation.  These  thought  process  models  may  be 
summarized  as  follows. 

a)  In  concrete  operational  thought,  individuals  approach  prob¬ 
lems  either  through  intuitive  affect,  analogic  reasoning,  or 
through  following  a  standard  operating  policy  or  organiza¬ 
tional  processes,  or  some  related  process. 

b)  In  formal  operational  thought,  individuals  approach  prob¬ 
lems  through  structuring  in  terms  of  imbedding  realities 
into  possibility  scenarios,  hypothetico-deductive  reasoning, 
and  interpretation  in  terms  of  operations  on  operations. 

Fig.  7  presents  our  conceptualization  of  information  acquisition, 
analysis,  and  interpretation  or  problem  solving  styles.  This  figure 
does  not  illustrate,  however,  the  fundamentally  dynamic  nature 
of  this  process  model.  Fig.  6  has  presented  some  of  the  dynamic 
learning  experiences  which  link  the  concrete  operational  and 
formal  operational  thought  processes.  Again  we  argue  that  no 
style  is  inherently  appropriate  or  inappropriate.  Appropriateness 
of  a  particular  style,  as  has  been  mentioned  before,  is  very  much 
task,  environment,  and  experience  dependent.  That  most  de¬ 
cisionmakers  function  as  concrete  operational  thinkers  is  doubt¬ 
lessly  correct.  A  principal  task  of  a  well-designed  information 
system  is  to  assist  in  aiding  the  decisionmaker  to  detect  the 
appropriate  style  for  a  given  task,  environment,  and  decision¬ 
maker  experience  level.  Another  task  is  to  enhance  transfer  of 
formal  operational  experiences  to  concrete  operational  experi¬ 
ences.  such  as  through  conceptualization  and  evolution  of  ap¬ 
propriate  heuristics,  wholistic  thought,  analogous  reasoning 
guides,  standard  operating  procedures,  other  forms  of  affective 
thought,  and  perhaps  even  precognitive  responses.  We  posit  that 
both  types  of  information  acquisition  and  analysis  may  occur 
with  cither  concrete  or  formal  thought  although  the  appropriate 
balance  of  receptive  and  preceptive  acquisition  and  analysis  will 
vary  from  situation  to  situation. 

Our  discussions  have  indicated  the  strong  environmental  de¬ 
pendence  of  the  formulation,  analysis,  and  interpretation  steps 
necessary  for  problem  resolution.  These  steps  are  necessary  steps 
in  the  resolution  of  any  issue  using  systemic  means,  regardless  of 
the  “style"  adopted  for  problem  solution.  Environments,  organi¬ 
zations.  and  technologies  arc  three  dominant  concerns  of  systems 
engineering  in  general  and  for  the  design  of  systems  for  planning 
and  decision  support  in  particular.  It  is  the  interaction  of  the 
environment  with  an  organization  and  a  technology  that  results 
in  a  management  technology.  Systems  management  is  the  term 
we  use  to  denote  the  interaction  of  human  judgment  with  meth¬ 
odological  concerns  ( 305 ] - [ 308 j  Systems  management  denotes, 
therefore,  concerns  at  the  cognitive  process  level  that  involve  the 
contingency  task  structure  and  its  role  in  influencing  the  selection 


of  performance  objectives  and  decision  rules  for  evaluation  of 
options  associated  with  issue  resolution.  There  are  many  in¬ 
fluences  which  act  on  the  contingency  task  structure.  Fig.  2 
indicates,  conceptually,  how  the  contingency  task  structure,  and 
the  environment  which  influences  it,  acts  to  specify  and  direct 
problem  solving  efforts  through  selection  of  performance  objec¬ 
tives  and  associated  information  processing  and  decision  rule 
paradigms. 

It  is  our  belief  that  the  dynamic  cognitive  style  models  of  Figs. 
6  and  7  can  be  used  as  guides  to  illustrate  both  those  modes  of 
information  acquisition  and  information  evaluation  that  should 
be  used  and  that  will  be  used  on  a  given  issue.  We  stress  that  the 
particular  cognitive  style  most  appropriate  for  a  given  issue  will 
depend  upon  the  decisionmakers  familiarity  with  a  given  issue, 
the  issue  itself,  and  the  environment  into  which  the  issue  is 
imbedded.  Thus  a  receptive  or  preceptive  information  acquisition 
style  will  be  appropriate  in  a  formal  operational  setting  if  the 
issue  at  hand  is  an  unfamiliar  and  unstructured  one.  The  ap¬ 
propriate  balance  between  preceptive  and  receptive  information 
acquisition  will  be  dependent  upon  the  type  of  issue  and  the 
experience  or  familiarity  the  decisionmaker  has  with  possible 
information  sources  and  their  likely  reliability.  It  will,  of  course, 
also  be  influenced  by  the  “personal”  style  of  the  decisionmaker 
and  the  type,  if  any,  of  interaction  with  the  systems  analyst  as 
well  as  upon  other  characteristics  of  the  decision  situation.  We 
accept  the  view  that  systems  methodologies,  especially  as  imple¬ 
mented  through  use  of  human  judgment  to  form  a  systemic 
process,  are  highly  value  dependent.  Different  systems  methodol¬ 
ogies  allow  one  to  define  issues  in  different  ways  and  are  respon¬ 
sive  in  differing  amounts  to  value  concerns,  such  as  equity.  Some 
methodologies  explicitly  encourage  for  example,  detection  of  the 
use  of  deficient  heuristics  and  encourage  correction.  The  "trans¬ 
parency”  and  communicability  of  a  decision  process,  for  exam¬ 
ple.  is  very  much  a  function  of  the  methodologies  used  in  process 
aiding  for  the  formulation  of  issues,  the  analysis  of  alternatives, 
and  associated  interpretation  efforts.  This  value  dependence  of 
systems  methodologies  is.  therefore,  an  important  aspect  of  infor¬ 
mation  system  design  and  is  related  to  performance  objectives  for 
the  task  at  hand. 

There  have  been  a  number  of  studies  which  focus  upon  the 
critical  importance  of  task  description  and  the  decisionmaker's 
interaction  with  the  task  through  the  environment.  Dawes  [70], 
171)  stresses  the  critical  interaction  among  the  mind  and  the  task, 
and  integrated  models  of  the  mind  and  the  task  requirements.  He 
discusses  the  “even  numbcrcd-vowel"  experiment  described  earlier 
in  this  section  as  docs  Anderson  (7).  Anderson  indicates  that  the 
failure,  and  a  majority  of  educated  adults  do  fail,  to  correctly 
resolve  this  task  is  due  to  difficulties  in  applying  the  modus  tollens 
concept  of  conditional  deductive  reasoning,  a  concept  which 
requires  thinking  about  what  is  not  the  case.  Anderson  also 
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discusses  a  slight  variation  of  this  task,  which  is  generally  the 
same,  and  in  which  almost  all  subjects  performed  correctly.  The 
task  involved  looking  at  four  pictures  of  ordinary  letter  envelopes 
with  the  possibility  of  a  stamp  on  them  and  picking  the  letters 
which  should  be  turned  over  to  test  the  hypothesis;  if  a  letter  is 
sealed,  it  has  a  180  stamp  on  it.  The  critical  difference  between 
the  two  tasks  is  the  fact  that  most  people  have  experiences  similar 
to  the  second  task.  It  is  relatively  familiar  compared  to  the  first 
task,  concerning  which  people  do  not  have  significant  experience. 

We  should  be  rather  cautious  however  in  the  apparently  rea¬ 
sonable  inference  that  we  leant  correctly  from  experience.  A 
number  of  important  studies  by  Brehmer  [46],  [47]  have  shown 
that  by  no  means  do  people  always  improve  their  judgment  and 
decisionmaking  ability  on  the  basis  of  increased  experience.  Bi¬ 
ases.  such  as  the  tendency  to  use  confirming  evidence  to  the 
neglect  of  disconfirming  evidence,  are  the  key  culprits.  Brehmer 
[47]  indicates  how  these  biases  can  be  understood  in  terms  of 
available  information.  He  concludes  that  truth  is  not  manifest.  It 
needs  to  be  inferred  in  order  to  extract  from  experience  informa¬ 
tion  components  that  will  truly  lead  to  better  judgments  and 
decisions.  The  recent  definitive  discussion  of  judgment  and  choice 
processes  by  Einhom  and  Hogarth  [98]  emphasizes  the  impor¬ 
tance  and  the  interdependence  of  attention,  memory,  cognitive 
representations,  learning,  conflict,  and  feedback.  It  provides  much 
valuable  perspective  concerning  the  importance  of  these  topics 
for  judgment  and  decisionmaking. 

Carroll  [56]  is  much  concerned  also  with  understanding  deci¬ 
sion  behavior,  especially  through  the  process  tracing  techniques 
that  have  been  emphasized  by  Payne  [272]— [275J.  Carroll  propo¬ 
ses  that  the  decisionmaker  might  better  be  portrayed  as  possess¬ 
ing  a  rich  store  of  knowledge  organized  around  a  variety  of 
evoked  schemas,  those  complex  unit:;  of  organized  knowledge 
which  guide  the  acquisition  and  use  of  case  information,  rather 
than  exclusively  considering  the  decisionmaker  as  exhaustively 
following  the  prescriptions  of  normative  models.  Many  of  the 
chapters  in  the  recently  edited  works  of  Estes  [100],  Hamilton 
[137],  Howell  [167],  Howell  and  Fleishman  [165],  Schwcder  [332], 
and  Wallsten  [396]  discuss  issues  related  to  cognitive  factors  in 
judgment  processes,  including  task  descriptions  for  scripts,  those 
stereotypical  sequences  of  actions  and  event  schemas  which  often 
are  of  much  use  in  explaining  judgment. 

Studies  of  information  support  for  U  S.  Air  Force  command 
and  communication  systems  accomplished  by  Klein  [202],  [203] 
express  a  number  of  concerns  regarding  artificial  intelligence  and 
information  processing  approaches  for  decision  aiding.  These 
reservations  concern  potential  inabilities  of  humans  to  disaggre¬ 
gate  situations  into  components  and  to  analyze  these  discrete 
components.  He  indicates  that  the  proficient  performance  of 
experts  may  well  be  based  more  on  reasoning  by  analogy  than  by 
representations  in  terms  of  step  by  step  descriptions  capable  of 
(discrete)  digital  computer  processing.  Further,  expert  proficient 
performers  may  not  follow  explicit  conscious  rules.  Requiring 
them  to  do  so  may  reduce  performance  qualitv,  and  they  will  be 
unable  to  accurately  describe  the  rules  that  they  do  follow  Klein 
views  expertise  as  arising  from  perceptual  abilities  including 
rccoemtional  capacity  in  terms  of  analogous  situations,  sensitivity 
to  environmental  context  in  the  sense  of  appreciation  of  the 
significance  of  subtle  sanations,  and  sensitivitv  to  intentional 
context  by  viewing  the  relevance  and  importance  of  (ask  compo¬ 
nents  as  a  whole  by  anticipating  what  has  to  occur  to  achieve  a 
goal  rather  than  just  what  will  occur  at  the  next  time  instant  or 
step.  He  presents  a  companson-guided  model  of  proficient  de¬ 
cisionmaking.  In  this  model  [203] 

1)  a  current  decision  situation  is  perceived  in  terms  of  objec¬ 
tives; 

2)  the  decisionmakers'  experience  allows  recognition  of  a 
comparison  situation: 

3)  similarities  and  differences  between  the  comparison  situa¬ 
tion  and  the  current  situation  arc  noted; 


4)  this  application  suggests  options,  including  evaluation  of 
options  and  selection  of  a  preferred  option  based  on  what 
worked  in  the  comparison  option;  and 

5)  the  way  the  objectives  and  the  decision  are  perceived, 
possible  further  adjustments  of  options,  generation  of  new 
options,  and  combination  of  options,  follow  from  this. 

Klein  strongly  encourages  development  of  decision  aids  to 
support  the  rccognitional  capacity  of  the  expert;  aids  that  will 
assist  the  expert  in  recognizing  new  situations  in  terms  of  analo¬ 
gous  comparison  cases  and  in  using  these  to  define  options  or 
alternatives.  The  adjuvant  would  also  keep  track  of  options,  assist 
in  generation  of  new  ones,  and  perform  computations  to  assess 
the  impacts  of  various  options.  It  certainly  appears  that  this  is  a 
needed  and  necessary  role  for  information  systems  adjuvants  for 
planning  and  decision  support.  But  it  must  be  remembered  that 
not  all  users  of  such  a  system  will  be  proficient  and  expert  in  all 
of  the  tasks  they  are  to  perform.  We  suggest  the  need  also  for 
provisions  for  formal  operational  thought  type  processes  for 
those  contingency  task  situations  that  have  not  been  sufficiently 
cognized  such  that  appropriate  use  of  concrete  operational 
thought  necessarily  leads  to  efficient  and  effective  performance. 

Dreyfus  and  Dreyfus  [82]  also  argue  that  experienced  and 
expert  human  decisionmakers  solve  new  problems  primarily  by 
seeing  similarities  to  previously  experienced  situations  in  them. 
They  argue  strongly  that  since  similarity  based  processes  actually 
used  by  experienced  and  expert  humans  lead  to  better  perfor¬ 
mance  than  formal  approaches  practiced  by  beginners,  de¬ 
cisionmaking  based  on  proven  expertise  should  not  be  replaced 
by  formal  models.  They  pose  a  model  which  contains  five  devel¬ 
opmental  stages  through  which  a  person  passes  in  acquiring  a 
skill  such  as  to  become  a  proficient  expert.  Their  basic  tenet  is 
that  people  demand  less  and  less  on  abstract  principles  and  more 
and  more  on  concrete  experience  as  they  become  proficient.  Their 
five  stages  and  suggested  instruction  at  each  stage  are  as  follows. 

1)  Novice—  Decompose  the  task  environment  into  context-free 
nonsituational  features  which  the  beginner  can  recognize  without 
experience.  Give  the  beginner  rules  for  determining  action  and 
provide  monitoring  and  feedback  to  improve  rule  following. 

2)  Competence —  Encourage  aspect  recognition  not  bv  calling 
attention  to  recurrent  sets  of  features,  but  rather  by  singling  out 
perspicuous  examples.  Encourage  recognition  of  dangerous 
aspects  and  knowledge  of  guidelines  to  correct  these  conditions. 
Equal  importance  weights  are  typically  associated  with  aspects  at 
this  stage. 

3)  Proficiency— This  comes  with  increased  practice  that  ex¬ 
poses  one  to  a  variety  of  whole  situations.  Aspects  appear  more 
or  less  important  depending  upon  relevance  to  goal  achievement. 
Contextual  identification  is  now  possible  and  memorized  princi¬ 
ples.  called  maxims,  are  used  to  determine  action. 

4)  Expertise  —  The  repertoire  of  experienced  situations  is  now 
vast,  such  that  the  occurrence  of  a  specific  situation  triggers  an 
intuitively  appropriate  action. 

5)  Masters  -The  expert  is  absorbed  and  no  longer  needs  lo 
devote  constant  attention  to  performance.  There  is  no  need  for 
self  mom  ion  ng  of  performance  and  energy  is  devoted  only  to 
identifying  the  appropriate  perspectives  and  appropriate  alterna¬ 
tive  actions. 

Drevfus  and  Dreyfus  associate  the  development  of  these  five 
'kill  categories  with  successive  transformation  of  four  mental 
functions  Fig  8  |X2]  indicates  how  these  transformations  occur 
with  increased  stages  of  proficiency.  While  developed  primarily 
for  training  this  model  contains  much  of  importance  with  respect 
to  information  system  design  to  support  planning  and  decision- 
making  as  well.  A  key  issue  in  this  table  would  appear  to  be  the 
development  of  concrete  situational  experience  which  first  occurs 
when  a  person  is  able  to  recognize  aspects.  There  seems  to  exist 
some  comphmentaritv  between  our  model  of  the  cognitive  judg¬ 
ment  and  decision  process  and  that  of  Drevfus  and  Dreyfus.  The 
concrete  operational  thought  of  experienced  decisionmakers 
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would  appear  to  be  much  the  same  as  the  thought  of  the  expert 
and  the  master.  Of  course  in  all  of  these  models,  ‘‘expert”  is  a 
relative  term,  with  the  environment  and  the  contingency  task 
structure  of  a  specific  situation  needed  to  determine  whether  a 
decisionmaker  is  familiar  and  experienced  with  it.  Some  dif¬ 
ferences  in  the  models  are  doubtlessly  present  as  well.  Some  of 
these  depend  upon  precisely  what  is  meant  by  "processing  infor¬ 
mation.”  Our  definition  is  rather  broad  and  certainly  not  re¬ 
stricted  to  quantitative  processing.  Generally  information 
processing,  in  our  view,  includes  the  formulation  or  acquisition, 
analysis,  and  interpretation  of  data  of  value  for  decisionmaking. 
This  can  be  accomplished  holistically,  heuristically,  or  wholisti- 
cally. 

Very  important  concerns  exist,  in  our  view,  with  respect  to 
possible  cognitive  bias  and  value  incoherencies  in  the  concrete 
operational  decisionmaking  of  experts  or  masters.  Questions  re¬ 
lated  to  the  effects  of  changing  environments  upon  the  judgment 
and  decision  quality  of  masters  and  novices  alike  are  very  im¬ 
portant  in  all  of  these  models.  For  intuitive  experience  may  not 
be  a  good  guide  for  judgments  and  decisions  in  uncertain,  un¬ 
familiar.  and/or  rapidly  changing  environments.  But  quantitative 
or  qualitative  analysis-based  efforts  may  well  not  be  very  good 
either  due  to  changed  decision  situation  and  contingency  task 
structural  models.  In  our  view  it  is  possible  to  become  a  "master;” 
but  unfortunately  possible  to  become  a  master  of  the  art  of 
self-deception  as  well  as  of  a  specific  task.  The  external  behavior 
of  the  two  “masters"  may  well  be  the  same;  situational,  wholistic. 
intuitive,  and  absorbed.  What  was  an  appropriate  style  for  one 
“master”  may  well  be  inappropriate  for  another. 

Behavior  in  familiar  but  uncertain  environments  is  of  much 
interest.  Studies  of  failure,  situations  in  which  experts  and  mas¬ 
ters  fail  or  misdiagnose  their  degree  of  expertise  or  mastery,  could 
yield  exceptionally  useful  results  and  would  also  serve  to  incorpo¬ 
rate  and  integrate  much  of  the  experimental  work  involving 
biases,  poor  heuristics,  and  value  coherences  into  a  more  real 
decision  situation.  We  hypothesize  that  the  dynamic  models  of 
decision  styles  presented  in  this  section  will  be  useful  vehicles  to 
these  ends. 

Judgment  and  decisionmaking  efforts  are  often  characterized 
by  intense  emotion,  stress,  and  conflict:  especially  when  there  are 
significant  consequences  likely  to  follow  from  decisions.  As  the 
decisionmaker  becomes  aware  of  various  risks  and  uncertainties 
that  mav  be  associated  with  a  course  of  action,  this  stress 
becomes  all  the  more  acute  Jams  and  Mann  (176|.  (I77j  have 
developed  a  conflict  model  of  decisionmakinz.  Conflict  here 
refers  to  “simultaneous  and  opposing  tendencies  within  the  indi¬ 
vidual  to  accept  and  reiect  a  given  course  of  action."  Symptoms 
of  conflicts  may  be  hesitation,  feelings  of  unccrtaints.  vacillation, 
and  acute  emotional  stress  with  an  unpleasant  feeling  of  distress 
being,  tvpicallv.  the  most  prevalent  of  all  characteristics  associ¬ 
ated  with  decisionmaking  (49|.  The  major  elements  associated 
with  the  conflict  model  are  the  concept  of  vigilant  information 


processing,  the  distinction  between  hot  and  cold  cognitions,  and 
several  coping  patterns  associated  with  judgments. 

Cold  cognitions  are  those  made  in  a  calm  detached  environ¬ 
mental  state.  The  changes  in  utility  possible  due  to  different 
decisions  are  small  and  easy  to  determine.  Hot  cognitions  are 
those  associated  with  vital  issues  and  concerns,  and  are  associ¬ 
ated  with  a  high  level  of  stress.  Whether  a  cognition  is.  or  should 
be,  hot  or  cold  is  dependent  upon  the  task  at  hand  and  the 
experiential  familiarity  and  expertness  of  the  decisionmaker  with 
respedt  to  the  task.  The  symptoms  of  stress  include  feelings  of 
apprehensiveness,  a  desire  to  escape  from  the  distressing  choice 
dilemma,  and  self-blame  for  having  allowed  oneself  to  get  into  a 
predicament  where  one  is  forced  to  choose  between  unsatisfac¬ 
tory  alternatives.  Janis  and  Mann  [177]  state  that  “psychological 
stress"  is  used  as  a  generic  term  to  designate  unpleasant  emo¬ 
tional  states  evoked  by  threatening  environmental  events  or 
stimuli.  They  define  a  “stressful”  event  as  “any  change  in  the 
environment  that  typically  induces  a  high  degree  of  unpleasant 
emotion,  such  as  anxiety,  guilt,  or  shame,  and  which  affects 
normal  patterns  of  information  processing.”  Janis  and  Mann 
describe  five  functional  relationships  between  psychological  stress 
and  decision  conflict. 

1)  The  degree  of  stress  generated  by  decision  conflict  is  a 
function  of  those  objectives  which  the  decisionmaker  ex¬ 
pects  to  remain  unsatisfied  after  implementing  a  decision. 

2)  Often  a  person  encounters  new  threats  or  opportunities  that 
motivate  consideration  of  a  new  course  of  action.  The 
degree  of  decision  stress  is  a  function  of  the  degree  of 
commitment  to  adhere  to  the  present  course  of  action. 

3)  When  decision  conflict  is  severe  because  all  identified  alter¬ 
natives  pose  serious  risks,  failure  to  identify  a  better  deci¬ 
sion  than  the  least  objectionable  one  will  lead  to  defensive 
avoidance. 

4)  In  severe  decision  conflict  when  the  decisionmaker  antic¬ 
ipates  having  insufficient  lime  to  identify  an  adequate  alter¬ 
native  that  will  avoid  serious  losses,  the  level  of  stress 
remains  extremely  high.  The  likelihood  that  the  dominant 
pattern  of  response  will  be  hypcrvigilancc.  or  panic,  in¬ 
creases. 

5)  A  moderate  degree  of  stress,  which  results  when  there  is 
sufficient  time  to  identify  acceptable  alternatives,  in  re¬ 
sponse  to  a  challensting  situation,  induces  a  vigilant  effort  to 
carcfullv  scrutinize  all  identified  alternative  courses  of  ac¬ 
tion  and  to  select  a  good  decision. 

Based  upon  these  five  functional  relation  propositions.  Jams 
and  Mann  present  five  coping  patterns  which  a  decisionmaker 
would  use  as  a  function  of  the  level  of  stress:  uneonflictcd 
adherence  or  inertia,  uneonflicted  change  to  a  new  course  of 
action,  defensive  avoidance,  hvpervigitanec  or  panic,  and  vigi¬ 
lance  Those  five  coping  patterns,  in  conjunction  with  the  five 
functional  relation  propositions  of  psychological  stress,  were  used 
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Fig.  9.  Interpretation  of  the  Jams  and  Mann  [  177]  conflict  model  of  decisionmaking. 


by  Janis  and  Mann  to  devise  their  conflict  model  of  decisionmak¬ 
ing.  This  model  postulates  that  each  pattern  of  decision  stress  for 
coping  is  associated  with  a  characteristic  mode  of  information 
processing.  It  is  this  mode  of  information  processing  which 
governs  the  type  and  amount  of  information  the  decisionmaker 
will  prefer.  Fig.  9  presents  an  interpretation  of  this  conflict  model 
of  decisionmaking  in  terms  of  the  systems  engineering  con¬ 
tingency  models  discussed  in  this  section.  This  model  points 
to  a  number  of  markedly  different  tendencies  which  become 
dominant  under  particular  conditions  of  stress.  These  include 
open-mindedness,  indifference,  active  evasion  of  discomfirming 
information,  failure  to  assimilate  new  information,  and  all  of  the 
other  cognitive  information  processing  biases  identified  in  Sec¬ 
tion  III.  Table  II  summarizes  information  processing  preferences 
and  decision  styles  generated  by  this  conflict  mode.  The  table 
depicts  the  striking  complexity  entailed  by  the  vigilant  informa¬ 
tion  processing  pattern  in  comparison  to  the  other  coping  pat¬ 
terns.  The  vigilance  pattern  is  characterized  by  seven  key  steps 
which  require  somewhat  prolonged  deliberation.  The  other  four 
coping  patterns  require  that  only  a  few  key  steps  be  addressed. 
Selection  of  a  coping  pattern  may  be  made  properly  or  unwisely, 
just  as  selection  of  a  decision  style  may  be  proper  or  improper. 
The  seven  steps  of  vigilant  information  processing  appear  quite 
equivalent  to  the  steps  of  systems  engineering. 

Janis  and  Mann  (177)  combine  the  hypotheses  they  present 
concerning  the  four  stages  of  the  decisionmaking  (which  we 
discuss  in  Section  I),  the  five  functional  relation  propositions  of 
psychological  stress,  and  the  five  stress  coping  patterns.  Also  they 
present  a  decision  balance  sheet,  an  adaptation  of  the  moral 
algebra  of  Beniamin  Franklin  1177],  on  which  to  construct  a 
profile  of  the  identified  options  together  with  various  cost  and 
benefit  attributes  of  possible  decision  outcomes.  They  have  shown 
that  decision  regret  reduction  and  increased  adherence  to  the 
adopted  decision  results  from  use  of  this  balance  sheet  Strategies 
for  challenging  outworn  decisions  and  improving  decisions  qual¬ 
ity  are  also  developed  in  this  seminal  work. 

It  would  be  of  considerable  interest  to  indicate  the  typical 
interactions  between  this  model  of  Jams  and  Mann,  which  would 
be  an  expanded  version  of  Fig.  I  and  the  other  three  contingency 
task  structure  models  of  decision  style  that  we  have  discussed  in 
this  section.  We  believe  each  of  these  models  to  be  appropriate 
and  to  portrav  different  relevant  features  of  task  evaluation. 


information  processing  preference,  and  decision  rule  selection  in 
terms  of  contingency  elements  associated  with  the  environment 
and  the  decisionmaker’s  prior  experiences. 

There  are.  of  course,  other  models  of  the  planning  and  de¬ 
cisionmaking  process.  Within  the  field  of  artificial  intelligence 
there  exists  a  growing  important  body  of  literature  concerning 
models  of  cognitive  processes  in  planning  and  decisionmaking 
(ISO],  [398],  The  work  of  the  Haves-Roths  [150]  is  definitive  in 
this  regard.  It  presents  a  model  of  the  independent  actions  of  a 
large  number  of  cognitive  specialists  who  make  tentative  deci¬ 
sions  for  incorporation  into  a  tentative  plan.  Different  specialists 
influence  different  portions  of  a  plan  and  reguard  decisions 
concerning  the  plan  on  a  common  data  structure  called  a  “black¬ 
board."  This  blackboard  allows  specialists  to  retrieve  prior  plans 
and  decisions  and  to  combine  earlier  decisions  with  present 
decisions,  thereby  potentially  generating  new  decisions.  A  process 
description  of  how  knowledge  generated  during  issue  resolution  is 
structured,  stored,  and  used  is  available. 

The  basis  assumptions  underlying  the  planning  model  are:  that 
decisions  occur  at  several  different  levels  of  abstraction,  that 
present  decisions  will  constrain  subsequent  decisions,  and 
that  people  can  adopt  alternative  and  appropriate  strategies  for 
planning.  This  important  research  suggests  areas  in  which  present 
and  prospective  planners  need  training  by  potentially  allowing 
determination  of  differences  in  the  information  processing  and 
judgment  strategies  of  people  as  a  function  of  task  and  environ¬ 
ment. 

VI.  Decisionmaking  Frameworks  and 
Organizational  Settings 

We  have  already  discussed  such  topics  as  decisionmaking 
rules,  cognitive  styles,  information  processing  and  contingency 
task  structural  models.  Each  of  these  represents  a  necessary 
component  in  the  description  of  components  of  the  decisionmak¬ 
ing  process.  While  these  components  are  all  necessary  for  under¬ 
standing  of  the  decision  process,  they  are  not  sufficient.  In 
particular  the  nature  of  the  decisionmaking  process  is  very  much 
influenced  by  the  topics  to  be  discussed  m  this  section:  various 
types  of  reasoning,  the  degree  of  approximation  to  various  con¬ 
ceptual  models  of  decisionmaking,  the  degree  of  centralization  of 
the  decision  process,  and  the  effects  of  these  factors  upon  infor- 
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mation  acquisition.  All  of  these  factors  are  typically  related  and 
all  are  part  of  the  contingency  task  structure. 

Characterizations  of  Rationality 

Diesing  [77]  is  among  several  writers  such  as  Steinbruner  [359], 
who  have  defined  several  forms  or  types  of  rationality.  Diesing 
defines  five  forms  of  rationality. 

1)  Technical  Rationality — This  results  from  efficient  achieve¬ 
ment  of  a  single  goal.  A  technically  rational  organization  is  one  in 
which  all  of  the  activities  of  the  organization  are  efficiently 
organized  to  achieve  the  goal  of  the  organization.  Technological 
progress  requires  an  increase  in  the  efficiency  of  the  productive 
process  and  the  existence  of  social  conditions  that  make  this 
increased  efficiency  possible.  Diesing  notes  that  a  technological 
innovation  that  deals  only  with  more  efficient  means  to  a  single 
end  will  often  have  rather  limited  influence  if  the  impacts  of  the 
technology  and  resulting  attributes  are  morally  and  psychologi¬ 
cally  isolated  from  one  another. 

2)  Economic  Rationality — This  results  from  maximum  achieve¬ 
ment  of  a  plurality  of  goals.  There  arc  four  characteristics  needed 
for  existence  of  an  economy.  Two  of  these  relate  to  allocation: 
plurality  of  alternative  ends,  common  means  to  the  ends,  scarcity 
of  resources:  and  availability  of  a  value  system  and  associated 
measurements.  Two  characteristics  relate  to  exchange:  plurality 
of  economic  units,  and  a  different  prioritization  of  values  among 
these  units.  Diesing  claims  that  maximum  goal  achievement  or 
economic  rationality  is  possible  if 

a)  the  ends  (goals)  of  the  economic  units  are  comparable  and 
measurable  on  a  single  scale: 

b)  there  are  no  limits  on  the  assignability  and  use  of  the 
means: 

c)  economic  units  are  integrated  enough  to  engage  in  rational 
allocation  and  exchange;  and 

d)  information  about  the  supply-demand  relationships  for  the 
various  units  is  available  and  known  to  ail. 

Consequently  economizing  includes  both  evaluation  and  selection 
of  various  ends  and  means.  Clearly  it  is  desirable  that  conditions 

a)— d>  hold  but  there  exist  many  approaches  to  maximization 
under  constraints  that  may  be  used  to  yield  optimum  resource 
allocation  under  constraints.  Economic  progress  is  equivalent  to 
an  increase  in  productivity  per  labor  hour  and.  consequently, 
increased  productivity  can  only  result  from  economic  and  techni¬ 
cal  change.  Economic  progress  will  typically  spread  rapidly 
throughout  a  culture  because  it  allows  more  and  more  ends  to 
become  both  alternatives  to  each  other  and  means  to  other  ends 
as  well.  Generally  the  rational  actor  model  we  have  discussed 
before  is  equivalent  to  Dicsing's  model  of  economic  rationality. 

3)  Social  Rationality— A  social  system  is  an  organization  of 
cultural  roles  such  as  expectations,  obligations,  and  ideals.  A 
social  system  is  said  to  be  integrated  when  the  various  associated 
activities  fit  well,  support,  confirm,  enrich,  and  reinforce  one 
another.  Social  integration  is  more  than  mechanical  efficiency 
and  cons'  tenev  due  to  the  mutual  support,  enrichment,  con¬ 
firmation.  and  reinforcement  requirement.  This  integration  makes 
action  possible  by 

a)  channelinz  emotional  cncrcv  and  preventing  it  from  being 
diffused  and  lost: 

b)  eliminating  conflict  which  could  block  action: 

c)  providing  those  supporting  factors  which  strengthen  action 
and  which  allow  action  to  be  earned  through  to  completion; 
and 

d)  making  actions  n.-  re  meaningful  bv  allowing  them  to  be 
related  to  past  and  future  actions 

An  integrated  social  -vstem  is  a  rational  social  system  that 
enhances  the  meaningtul  and  successful  completion  of  actions. 
Sucecssfullv  completed  actions  arc  not  neccssartlv  either  efficient 


or  effective  as  integration  promotes  survivability  of  the  system 
and  not  necessarily  the  people  within  it.  In  extreme  cases  of 
inefficiency  or  ineffectiveness,  people  may  leave  the  system  and 
establish  another  one.  Four  characteristics  of  a  rational  social 
organization,  as  described  by  Diesing,  are 

a)  internally  consistent  roles  that  can  be  carried  out  by  the 
society  without  great  strain; 

b)  harmonious  roles  that  fit  together  without  conflict  among 
roles; 

c)  smoothly  evolving  roles  such  that  there  exists  continuity 
and  stability  with  no  sharp  impulsive  changes  in  roles  over 
time:  and 

d)  roles  compatible  with  the  nonsocial  (i.e..  geographic,  tech- 
noeconomic,  temporal,  and  physiological)  environment. 

As  it  develops  and  becomes  more  integrated,  a  social  system 
develops  a  value  system  that  reinforces,  through  feedback,  the 
structure  of.  and  roles  within,  the  social  system.  'Well-integrated 
socialiv-rational  systems  typically  resist  change  and  avoid  risk  in 
our  interpretation  of  Diesing.  One  might  argue,  of  course,  that  a 
well-integrated  social  system  should  be  adaptive  to  change  and 
that  failure  to  do  so  will  subject  it  to  a  greater  long  term  risk  than 
if  it  were  organically  adaptive  to  change.  This  is,  perhaps,  the 
difference  between  a  descriptive  view  and  a  normative  view  of  a 
well-integrated  social  system. 

4)  Lethal  Rationality— A  legally  rational  system  is  a  system  of 
rules  which  are  complex,  consistent,  precise,  and  detailed  enough 
to  be  capable  of  unambiguous  application.  Some  of  these  rules 
may  apply  impartially  to  all  people,  while  others  may  apply 
differently  to  different  classes  of  people.  A  “legally  rational” 
system  is  rational  because,  and  if.  it  is  effective  in  preventing 
disputes.  It  does  this  by  providing  a  framework  which  defines 
and  supports  performance  of  economic  and  social  rules.  This 
framework  also  provides  a  procedure  for  settlement  of  those 
disputes  which  occur. 

5)  Political  Rationality— This  is  the  rationality  of  decisionmak¬ 
ing  structures.  A  decisionmaking  structure  is  composed  of  a  set  ol 
discussion  relationships  and  a  set  of  beliefs  and  values  that  are 
imbedded  into  a  set  of  recognized  roles.  These  roles  have  been 
assigned  to  individuals  such  as  to  enable  actions  within  the 
context  of  previous  actions  and  commitments.  Politically  rational 
decision  structures  are  based  upon  three  guiding  imperatives, 
according  to  Diesing: 

a)  maintenance  of  independence  of  the  group  despite  all  pres¬ 
sures  for  dependence: 

b)  actions  to  structure  the  political  group  such  that  pressures 
are  balanced  and  moderate;  and 

c)  preparation  for  future  pressures  which  act  to  increase  the 
stability  and  political  rationality  of  the  decision  structure  bv 
providing  unification  and  broadening  of  participation. 

These  forms  of  rationality  are  certainly  related.  Technical 
rationality  is  necessary  for,  and  a  part  of.  economic  rationalitv. 
The  primary  characteristic  which  follows  from  rational  economic 
behavior  is  a  detachment  or  neutrality  of  intrinsically  valueless 
commodities.  These  are  useful  only  as  means  to  ends  such  that 
scalar  optimization  mav  be  used  to  select  the  commodity  bundle 
of  alternate  means.  Particularism  and  loyalty  are  the  primary 
characteristics  of  social  rationality  such  that  obligations  evolve 
from  particular  social  relations  with  individuals  and  groups  rather 
than  general,  universalist-detached  relations  which  arc  applicable 
to  all.  Ascription,  in  which  actions  towards  people  evolve  from 
particular  relations  rather  than  as  a  response  to  achievement,  is 
another  characteristic  of  social  rationality.  Thus  we  see  that  the 
characteristics  of  economic  rationality  may  contrast  sharply  with 
those  of  social  rationality.  But  this,  we  believe,  is  not  necessarily 
the  case  l  or.  as  Diesing  indicates,  neither  form  of  lationality  can 
exist  without  some  form  of  the  other.  Economic  rationality 
theories  arc  based  on  the  assumption  that  social  integration  is  a 
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reality;  such  that  there  exist  communication  and  valuation  capa¬ 
bilities  and  no  goal  conflicts  or  factionalism.  In  a  similar  way 
social  rationality  assumes  that  societies'  economic  resource  allo¬ 
cation  problems  are  solved. 

Social  and  political  rationality  are  related  in  the  sense  that 
both  are  primarily  concerned  with  internal  structural  concerns 
involving  process  and  procedure;  that  is.  the  structure  of  interper¬ 
sonal  relations,  or  the  accumulation  of  power,  or  the  direction  of 
pressure.  Economic  and  legal  rationality  are  primarily  concerned 
with  the  substantive  behavior  as  contrasted  with  procedural  and 
internal  structural  concerns.  We  have  argued  strongly  in  previous 
sections  that  substantive  and  procedural  rationality  [206],  [336] 
are  each  necessary  considerations  in  information  system  design. 

Decision  Frameworks 

We  have  presented  a  detailed  synopsis  of  the  perceptive  work 
of  Dicsing  [77]  concerned  with  five  different  forms  of  rationality. 
Additional  forms  of  rationality  [50].  perhaps  based  upon  the  ten 
interacting  societal  sectors  noted  [304],  [307]  could  doubtlessly  be 
developed.  It  would  be  of  interest  to  determine  the  extent  to 
which  these  additional  forms  of  rationality  would  be  subsets  of 
and  independent  of  the  five  forms  of  Diesing. 

March  [236]  discusses  bounded  rationality,  limited  rationality, 
contextual  rationality,  game  rationality,  and  process  rationality. 
A  study  of  relations  of  these  forms  of  ra;.onality  both  to  the 
rationality  forms  of  Diesing  and  decision  frameworks,  which  we 
will  now  discuss,  could  lead  to  useful  insights  and  more  relevant 
systemic  process  designs. 

The  organizational  science  literature  contains  much  discussion 
relative  to  the  development  of  conceptual  models  for  decision¬ 
making  based  upon  various  rationality  conceptualizations.  Among 
these  are  the  (economic)  rational  actor  model,  the  satisficing  or 
bounded  rationality  model,  the  bureaucratic  politics,  incremental, 
or  "muddling  through"  model,  the  organizational  processes  model, 
and  the  garbage  can  model.  These  are  related  to  the  five  types  of 
rationality  described  by  Dicsing  in  relatively  obvious  ways  that 
follow  directly  from  a  description  of  these  decision  frameworks. 

I)  The  Rational  Actor  Model:  The  decisionmaker  becomes 
aware  of  a  problem,  studies  it,  carefully  weighs  alternative  means 
to  a  solution  and  makes  a  choice  or  decision  based  on  an 
objective  set  of  values.  This  is  comparable  to  technical  and 
economic  rationality  as  described  by  Diesing.  At  first  glance  the 
rational  actor  model  appears  to  contain  much  of  value  and  to  be 
especially  well  matched  to  the  detached  neutrality,  calculative 
orientation,  and  avoidance  of  favoritism  associated  with  the 
achievement-oriented  entrepreneurial  western  society.  In  rational 
planning  or  decisionmaking 

a)  the  decisionmaker  is  confronted  with  an  issue  that  can  be 
meaningfully  isolated  from  other  issues; 

b)  objectives  are  identified,  structured,  and  weighted  according 
to  their  importance  in  achieving  need  satisfaction  on  various 
aspects; 

c)  possible  activities  to  resolve  needs  arc  identified: 

d)  the  impacts  of  action  alternatives  are  determined: 

e)  the  utilitv  of  each  alternative  is  evaluated  in  terms  of  its 
impacts  upon  needs:  and 

f)  the  utilities  of  all  alternatives  are  compared  and  the  police 
with  the  highest  utilitv  is  selected  for  action  implementa¬ 
tion 

These  arc  essentially  equivalent  to  the  vigilant  information 
processing  steps  of  Jams  and  Mann  (I77|. 

Unfortunately,  there  are  several  substantive  requirements  for 
successful  i omplete  rational  decisionmaking  that  will  not  gener- 
allv  be  met  in  practice.  These  include 

a)  comprehensive  identification  of  all  needs,  constraints,  and 
altcrables  relevant  to  planning  and  decisionmaking  is.  of 
course,  not  possible; 


b)  determination  and  clarification  of  all  relevant  objectives  is, 
of  course,  not  possible; 

c)  determination  and  minimization  of  costs  and  maximization 
of  effectiveness  will  not  necessarily  lead  to  the  “best"  results 
because  of  a)  and  b); 

d)  detached  neutrality  and  a  calculative  orientation  rather  than 
arbitrariness,  conflict,  and  coercion  are  not  always  possible; 

e)  a  unified  process  that  will  cope  with  interdependent  deci¬ 
sions  will  often  be  very  complex; 

f)  sufficient  time  to  use  the  method  will  often  not  be  available; 

g)  sufficient  information  to  enable  use  of  the  method  will  often 
be  difficult  and  expensive  to  obtain:  and 

h)  sufficient  cognitive  capacity  to  use  the  method  will  often 
not  exist. 

It  has  long  been  recognized  by  systems  engineers  and  manage¬ 
ment  scientists  that  the  attempt  to  use  a  normativelv  optimum 
process  will  result  in  less  than  optimum  results  because  of  these 
modeling  inaccuracies,  cognitive  limitations,  and  solution  time 
constraints.  Thus  the  presence  of  the  realities  of  a)-h)  will, 
because  of  a  combination  of  resource  and  intellectual  constraints, 
lead  to  selection  of  an  alternative  that  is  best  only  within  con¬ 
straints  posed  by  the  model  actually  used.  We  may  also  observe 
that  an  economically  rational  decision  would  only  be  appropriate 
when  the  decision  situation  structural  model  is  such  that  an 
economically  rational  process  is  possible  and  desirable,  and  that 
the  intellectual  and  resource  conditions  extant  make  substantive 
use  of  the  rational  actor  model  feasible. 

Simon  [337],  [339],  [340],  [343]  was  perhaps  the  first  to  observe 
that  unaided  decisionmakers  may  not  be  able  to  make  complete 
substantive,  that  is  "as  if,”  use  of  the  model  possible.  The 
concepts  of  bounded  rationality  and  satisficing  represent  much 
more  realistic  substantive  models  of  actual  decision  rules  and 
practices.  We  have  described  a  variety  of  satisficing  heuristic 
rules  in  Section  IV.  Unless  very  carefully  developed  and  applied, 
these  rules  may  result  in  very  inferior  decisions:  decisions  which 
are  reinforced  through  feedback  and  repetition  such  as  to  result 
in  experiences  that  are.  by  no  means,  the  best  teacher. 

Of  possibly  even  greater  importance  to  information  system 
design  is  the  fact  that  completely  economically  rational  processes 
may  be  neither  desirable  nor  possible.  Sociai.  political,  or  legal 
rationality  concerns  may  well  prevail.  And  one  of  the  other 
decision  frameworks  we  describe  here  may  well  be  more  ap¬ 
propriate  if  these  concerns  are  dominant  over  economic  rational¬ 
ity  concerns. 

2)  The  Satisficing  or  Bounded  Rationality  Model:  The  de¬ 
cisionmaker  looks  for  a  course  of  action  that  is  basically  good 
enough  to  meet  a  minimum  set  of  requirements.  The  goal  is  to 
“not  shake  the  system"  or  “play  it  safe"  by  making  decisions 
primarily  on  the  basis  of  short-term  acceptability  rather  than 
seeking  a  long-term  optimum. 

Simon  introduced  the  concept  of  satisficing  or  bounded  ration¬ 
ality  as  an  effort  to 

replace  the  global  rationality  of  economic  man  wiih  a  kind  of 
rational  behavior  lhal  is  compatible  with  the  access  to  information 
and  the  computational  capabilities  that  are  actually  possessed  by 
oritamsins.  includins  man.  in  the  kinds  of  environments  in  which 
such  organisms  exist 

He  suggested  that  decisionmakers  compensate  for  theii  limited 
abilities  by  constructing  a  simplified  representation  of  the  prob¬ 
lem  and  then  behaving  rationally  within  the  constraints  imposed 
bv  this  model  The  need  for  this  rests  in  the  fact  that  many 
decisionmakers  satisfice  bv  finding  either  optimum  solutions  in  a 
simplified  world  or  satisfactory  solutions  in  a  more  realistic 
world.  As  Simon  says,  "neither  approach  dominates  the  other 
(34l|" 

Satisficing  is  actually  searching  for  a  "good  enough"  choice. 
Simon  suggested  that  the  threshold  for  satisfaction,  or  aspiration 
level,  mav  change  according  to  the  ease  or  difficulty  of  search.  If 
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many  alternatives  can  be  found  the  conclusion  is  reached  that  the 
aspiration  level  is  too  low  and  needs  to  be  increased.  The  con¬ 
verse  is  true  if  no  satisfactory  alternatives  can  be  found.  This  may 
lead  to  a  unique  solution  through  iteration. 

The  principle  of  bounded  rationality  and  the  resulting  satisfic¬ 
ing  model  suggests  that  simple  heuristics  may  well  be  adequate 
for  complex  problem  solving  situations.  Satisficing  strategies  may 
be  excellent  for  repetitive  problems.  They  may  also  lead  to 
premature  choices  that  result  in  unforeseen  disasterous  conse¬ 
quences:  consequences  which  could  have  been  foreseen  bv  more 
careful  analysis.  The  heuristic  decision  rules  described  in  Section 
IV  are  all  versions  of  satisficing  strategies.  A  recent  paper  by 
Thorngate  [372]  provides  useful  descriptions  of  ways  in  which 
heuristic  decision  rules  may  be  used  and  abused.  Development  of 
efficient  and  effective  decision  heuristics  is  a  contemporary  need 
for  the  analysis  of  decision  behavior  [56],  [59],  [60],  the  modeling 
of  organizational  and  individual  decisions  [292],  [365]  as  well  as 
for  the  design  of  normative  systems  to  aid  decisionmaking  [316], 
We  believe  that  to  be  effective  as  well  as  efficient,  heuristics  will 
have  to  be  developed  in  a  very  cautious  way  with  due  considera¬ 
tions  for  the  many  implications  of  the  contingency  task  structure 
of  a  decision  situation  (326|. 

3)  The  Bureaucratic  Politics,  Incrementalism,  or  “Muddling 
Through''  Model:  After  problems  arise  which  require  a  change  of 
policy,  policymakers  consider  only  a  very  narrow  range  of  iter- 
natives  differing  to  a  small  degree  from  the  existing  policy.  One 
alternative  is  selected  and  tried  with  unforseen  consequences  left 
to  be  discovered  and  treated  by  subsequent  incremental  policies. 
This  is  the  incremental  view. 

In  1959  Lindblom  postulated  the  approach  called  incrementa¬ 
lism.  or  muddling  through  [2 1 8]-[22 1  ].  to  cope  with  perceived 
limitations  in  the  economically  rational  approach.  Marginal  val¬ 
ues  of  change  onlv  are  considered  —  and  these  for  only  a  few 
dimensions  of  value  whereas  the  rational  approach  calls  for 
exhaustive  analysis  of  each  identified  alternative  along  all  identi¬ 
fied  dimensions  of  value.  A  number  of  authors  have  shown 
incrementalism  to  be  the  typical,  common,  and  currently  prac¬ 
ticed  process  of  groups  in  pluralistic  societies.  Coalitions  of 
special  interest  groups  make  cumulative  decisions  and  arrive  at  a 
workable  compromise  through  a  give  and  take  process  that 
Lindblom  calls  “partisan  mutual  adjustment.”  He  indicates  that 
ideological  and  other  value  differences  do  not  influence  marginal 
decisions  as  much  as  major  changes  and  that,  in  fact,  considering 
marginal  values  subject  to  practical  constraints  will  lead  to  agree¬ 
ment  on  marginal  programs.  Further,  incrementalism  can  result 
in  agreement  on  decisions  and  plans  even  by  those  who  are  in 
fundamental  disagreement  on  values.  However  incrementalism 
appears  based  on  keeping  the  masses  marginally  content  and  thus 
may  not  be  able  to  do  much  to  help  the  greatly  underprivileged 
and  unrepresented.  It  is.  of  course,  a  combination  of  Diesing's 
social  and  political  rationality  Boulding  has  compared  in¬ 
crementalism  to  "staggering  through  history  like  a  drunk  putting 
one  disjointed  incremented  foot  after  another."  Yet  there  have 
been  a  number  of  studies,  such  as  Allison's  study  of  the  Cuban 
missile  crisis  [4],  Steinbruner's  case  studies  [359],  and  others  (44). 
1 1  OH).  [135],  [400]  which  indicate  this  to  be  an  often  used  ap¬ 
proach  in  practice. 

It  is  important  to  note  |2IK|  that  Lindblom  rejects  (economic) 
comprehensive  rati  rnalitv  even  as  a  normative  mode!  and  indi¬ 
cates  that  systems  analysis  will  often  lead  to  ill-considered,  often 
accidental  incompleteness.  He  indicates  the  following  inevitable 
limitations  to  analysis. 

ai  It  is  fallible,  never  rises  to  infallibility,  and  can  be  poorlv 
informed,  superficial,  biased,  or  mendacious. 

b)  It  cannot  wholly  resolve  conflicts  of  value  and  interests 

c)  Sustained  analysis  mav  be  too  slow  and  too  costly  com¬ 
pared  with  realistic  needs. 

d)  Issue  formulation  questions  call  for  acts  of  choice  or  will 
and  suggests  that  analysis  must  allow  room  for  politics. 


A  perceived  more  practical  model  process  for  decisionmakit 
than  the  rational  actor  model  is.  therefore,  called  for.  The  mod  ■ 
is  descriptive  and  is  an  extreme  version  of  the  bounded  rational¬ 
ity  model.  Alternative  models  have  been  proposed  [317],  _ 

The  main  features  of  the  model  proposed  by  Lindblom  are  tf 
following. 

1)  Ends  and  means  are  viewed  as  not  distinct.  Consequent! 
means-ends  analysis  is  viewed  as  often  inappropriate. 

2)  Identification  of  values  and  goals  is  not  distinct  from  the 

analysis  of  alternative  actions.  Rather,  the  two  processes  are 
confounded.  — 

3)  The  test  for  a  good  policy  is.  typically,  that  various  de 
cisionmakcrs.  or  analysts,  agree  on  a  policy  as  appropriate 
without  necessarily  agreeing  that  it  is  the  most  appropnate 
means  to  an  end. 

4)  Analysis  is  drastically  limited,  important  policy  options  are 
neglected,  and  important  outcomes  are  not  considered.  - 

5)  By  proceeding  incrementally  and  comparing  the  results  of 
each  new  policy  with  the  old.  decisionmakers  reduce  or 
eliminate  reliance  on  theory. 

6)  There  is  a  greater  preoccupation  with  ills  to  be  remedied 
rather  than  positive  goals  to  be  sought. 

In  a  very  readable  recent  work  concerning  “muddling  through 
[22 1]."  Lindblom  classified  incremental  analysis  at  three  levels: 
simple,  disjointed,  and  strategic.  Incremental  analysis  is,  as  we 
have  indicated,  a  good  description  of  political  decisionmaking 
and  is  sometimes  referred  to  as  the  political  process  model. 

4)  The  Organizational  Processes  Model :  Plans  and  decisions  are 
the  result  of  interpretation  of  standard  operating  procedures. 
Improvements  are  obtained  by  careful  identification  of  existing 
standard  operating  procedures  and  associated  organizational 
structures  and  determination  of  improvements  in  these. 

The  organizational  process  model,  originally  due  to  Overt  and 
March  [6H],  functions  by  relying  on  standard  operating  proce¬ 
dures  which  constitute  the  memory  or  intelligence  bank  of  the 
organization.  Only  if  the  standard  operating  procedures  fail  will 
the  organization  attempt  to  develop  new  standard  procedures. 

The  organizational  processes  model  may  be  viewed  as  an 
extension  of  the  concept  of  bounded  rationality  to  choicemaking 
in  organizations.  It  is  clearly  an  application  of  reasoning  and 
rationality  as  discovery  and  application  of  rules  to  cases.  It  may 
be  viewed  as  a  hybrid  of  economic  and  legal  rationality.  It 
typically  involves  concrete  operational  thought  as  we  have  indi¬ 
cated  in  Section  V  The  main  concepts  of  the  behavioral  theory  of 
the  firm,  which  is  suggested  as  a  descriptive  model  of  actual 
choicemaking  in  organizations  arc  as  follows. 

1)  Quasiresolution  of  conflict:  Major  problems  are  disaggre¬ 
gated  and  each  subproblem  is  attacked  locally  by  a  depart¬ 
ment.  An  acceptable  conflict  resolution  between  the  efforts 
of  different  departments  is  reached  through  sequential  at¬ 
tention  to  departmental  goals. 

2)  Uncertainty  avoidance  is  achieved 

a)  bv  reacting  to  external  feedback. 

b)  by  emphasizing  short-term  choices,  and 

c)  by  advocating  negotiated  futures. 

3)  Problem  search  in  which 

a)  search  is  stimulated  by  encountering  issues. 

b)  a  form  of  "satisficing"  is  used  js  a  decision  rule,  and 

c)  search  in  the  neighborhood  of  the  status  quo  only  is 
attempted  and  onlv  incremental  solutions  are  considered. 

4)  Organization  learning:  Organizations  adapt  on  the  basis  of 
experience. 

The  organizational  process  model  mav  be  viewed  as  suggesting 
that  decisions  at  time  t  mav  be  forecasted  with  almost  complete 
certainty  from  knowledge  of  decisions  at  time  t  -  T  where  T  is 
the  planning  or  forecasting  period.  Standard  operating  proce- 
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dures  or  “programs,”  and  education  motivation  and  experience 
or  “programming"  of  management  are  the  critical  determinants 
of  behavior  for  the  organizational  process  model. 

5)  The  Garbage  Can  Model:  This  relativelv  new  model  [63] 
views  organizational  decisionmaking  as  resulting  from  four  vari¬ 
ables:  problems,  solutions,  choice  opportunities,  and  people.  De¬ 
cisions  result  from  the  interaction  of  solutions  looking  for  prob¬ 
lems.  problems  looking  for  solutions,  decision  opportunities,  and 
participants  in  the  problem  solving  process.  The  model  allows  for 
these  variables  being  selected  more  or  less  at  random  from  a 
garbage  can.  Doubtlessly  this  is  a  realistic  descriptive  model.  It  is 
especially  able  to  cope  with  ambiguity  of  intention,  understand¬ 
ing,  history,  and  organization.  Further,  it  provides  much  support 
for  a  feedback  model  of  organizational  choice  in  which  pref¬ 
erences  and  cognitions  of  individuals  affect  their  behavior,  behav¬ 
ior  of  individuals  affect  organizational  choices,  organizational 
choices  affect  environmental  activities  and  responses,  and  en¬ 
vironmental  activities  and  responses  affect  the  preferences  and 
cognition  of  individuals  [237],  An  extensive  and  definitive  discus¬ 
sion  of  ambiguity  and  choice  in  organization,  with  emphasis  upon 
the  garbage  can  model,  is  contained  in  [237], 

All  five  of  the  models  or  frameworks  for  decisionmaking  have 
both  desirable  and  undesirable  characteristics.  Conclusions  may 
be  drawn  from  these  models  and  the  fact  that  any  of  them  may 
be  relevant  in  specific  circumstances.  If  we  accept  the  facts  that 

1)  decisionmakers  use  a  variety  of  methods  to  select  among 
alternatives  for  action  implementation: 

2)  these  methods  are  frequently  suboptimal:  and 

3)  most  decisionmakers  desire  to  enhance  their  decisionmaking 
efficiency  and  effectiveness; 

then  we  must  conclude  that  there  is  much  motivation  and  need 
for  research  and  ultimate  design  and  development  of  planning 
and  decision  support  systems.  But  these  five  models  make  it  very 
clear  that  improved  planning  and  decisionmaking  efficiency  and 
effectiveness  and  aids  to  this  end  can  only  be  accomplished  if  we 
understand  human  decisionmaking  as  it  is  as  well  as  how  it  might 
be  and  allow  for  incorporation  of  this  understanding  in  systemic 
process  adjuvants.  One  of  the  requirements  imposed  on  these 
adjuvants  will  be  relevance  to  the  individual  and  group  de¬ 
cisionmaking  structure  [181],  [237],  [286],  [303],  [401],  Another 
requirement  is  relevance  to  the  information  requirements  of  the 
decisionmaker.  We  discuss  both  of  these  in  this  section  of  our 
survey  and  interpretation. 

There  have  been  many  studies  of  group  decisionmaking.  These 
include  the  fundamental  theoretical  studies  of  Arrow  [17]  and 
others  which  show  that,  under  a  very  mild  set  of  realistic  axioms, 
there  is  no  assuredly  successful  and  meaningful  wav  in  which 
ordinal  preference  functions  of  individuals  may  be  combined  into 
a  preference  function  for  societv  [17],  [196],  [279],  [302].  Conflict¬ 
ing  values  [378]  are  the  major  culprit  preventing  this  combina¬ 
tion.  This  has  a  number  of  implications  which  suggest  much 
caution  in  using  ordinal  preference  voting  systems  and  anv 
systemic  approach  based  only  on  ordinal,  possiblv  wholistic.  or 
heuristic  preferences  among  alternatives.  Among  other  possible 
debilitating  occurrences  are  agenda  dependent  results  which  can. 
of  course,  be  due  to  other  effects  [280],  There  have  been  a 
number  of  studies  of  group  decisions  and  social  and  organi¬ 
zational  interactions  such  as  those  bv  Hacharagh  [19],  Davis 
|69|.  Ebert  and  Mitchell  [S9|.  Einhorn.  Hogarth,  and  Klcmpner 
[92j.  Holloman  and  Hendrick  [I62|.  Janis  and  Mann  [176],  [177], 
Leavitt  (211).  Mintzberg  [24X|.  Penrod  and  Hastie  [276],  Schein 
[3I2|.  Shumwav.  el  al.  [329],  Simon  [341],  Vinokur  and  Burnstein 
[390|.  [391]  and  in  the  edited  work  of  Hooker.  Leach,  and 
McC'tcnnen  [163].  Several  systemic  methods  have  been  proposed 
for  forming  and  aggregating  group  opinions  as  described  in  the 
works  of  Hogarth  ( 1 55],  Huber  (I69|.  Hvlland  and  Zcckhauser 
[173],  Rohrbaugh  [295],  Van  dc  Ven  and  Delbecq  [3SS|.  An 
excellent  survev  of  voting  methods  and  associated  paradoxes  is 
presented  by  Fishbum  1122]  and  bv  Plot!  [279] 


Very  definitive  studies  of  the  interpersonal  comparison  of 
utilities  have  been  conducted  by  Harsanyi  [  145]— [  147],  He  argues 
convincingly  that  we  make  interpersonal  utility  comparisons  all 
the  time  whenever  we  make  any  allocation  of  resources  to  those 
to  whom  we  feel  the  allocation  will  do  the  most  good.  The 
prescription  against  such  comparisons  is  one  of  two  key  restric¬ 
tions  which  lead  to  the  Arrow  impossibility  theorem.  By  using 
cardinal  utilities  such  that  it  becomes  possible  to  determine 
preferences  among  utility  differences  (i.e.  whether  u(a)  —  u(b)  > 
u(b)  -  u(  c )),  and  interpersonal  comparison  of  utilities.  Harsanyi 
shows  that  Arrow's  impossibility  theorem  becomes  a  possibility 
theorem.  This  is  a  major  point  in  that  it  is  generally  not  possible 
for  a  group  to  express  meaningful  transitive  ordinal  preferences 
for  three  or  more  alternatives  even  though  all  individuals  in  the 
group  have  individually  meaningful  transitive  ordinal  preferences. 

Harsanyi  is  concerned  primarily  with  organizational  design 
[147];  how  to  design  social  decisionmaking  units  so  as  to  maxi¬ 
mize  attainment  of  social  objectives  or  value  criteria.  He  shows 
that  rational  morality  is  based  on  maximization  of  the  average 
(cardinal)  utility  level  for  all  individuals  in  society.  The  utilitarian 
criterion  is  applied  first  to  moral  rules  and  then  these  moral  rules 
are  used  to  direct  individual  choices.  Thus  each  utilitarian  agent 
chooses  a  strategy  to  maximize  social  utility  under  the  assump¬ 
tion  that  all  other  agents  will  follow  the  same  strategy.  Harsanyi 
recognizes  a  potential  difficulty  [147]  with  this  particular 
utilitarian  theory  of  morality  in  that  it  is  open  to  dangerous 
political  abuses  as  well  as  the  numerous  problems  associated  with 
information  acquisition  and  analysis  in  a  large  centralized  sys¬ 
tem.  He  posits  a  difference  between  moral  rationality  and  game- 
theoretic  rationality.  He  argues  the  unavoidable  use  of  interper¬ 
sonal  cardinal  utility  comparisons  in  moral  rationality  and  the 
inadmissibility  of  such  comparisons  in  game  theory.  Much  of 
Harsanvi's  efforts  concern  game  situations  [146]  in  which  out¬ 
comes  depend  on  mutual  interactions  between  morally  rational 
individuals,  each  attempting  to  better  their  own  interests.  We  will 
not  attempt  to  explore  here  the  very  interesting  subjects  of 
bargaining,  conflict,  resolution,  and  negotiation  and  the  use  of 
svstems  for  planning  and  decision  support  to  these  ends  [21],  [45], 
[269], 

Harsanvi's  concept  of  utilitarianism  has  occasionally  been 
criticized  for  making  inadequate  provision  for  equity,  or  equiva¬ 
lently  for  social  group  equality.  John  Rawls,  a  philosopher,  has 
presented  a  theory  of  justice  [291]  which  involves  a  difference 
principle  in  which  decisions  are  made  under  uncertainty  rather 
than  under  risk.  This  difference  principle  advocates  selection  of 
the  alternative  choice  which  is  the  best  for  the  worst-off  member 
of  society  and  is.  therefore,  the  direct  social  analog  of  the 
maximum  principle  for  the  problem  of  individual  decisions  under 
certainty.  Rawls  uses  a  “veil  of  ignorance"  concept  in  which 
individuals  must  determine  equitable  distribution  of  societies' 
resources  before  they  know  their  position  in  society.  His  argu¬ 
ment  is  essentially  that  people  will  select  a  resource  allocation 
rule  that  maximizes  the  utility  of  the  worst-off  member  of  society. 
Discussions  of  some  of  the  potential  difficulties  associated  with 
Rawls'  "social  contract"  justice  theorv  are  presented  by  Ellsworth 
and  Gauthier  [163], 

Other  useful  interpretations  of  cardinal  utility  and  interper¬ 
sonal  utility  comparisons  have  been  made  bv  Kcenev  and 
Kirkwood  [  1  *44]  and  Kcenev  [195].  Their  axioms  allow  develop¬ 
ment  of  a  multiplicative  group  utility  function  in  contrast  to  the 
additive  utilitv  function  of  Harsanvi.  It  is  possible  to  more 
directly  deal  with  equity  considerations  in  a  multiplicative  group 
utility  model  than  in  an  additive  model.  Papers  by  Uodilv.  Brock, 
and  Keeney  [201]  contain  insightful  discussions  concerning  group 
and  individual  utilities  of  a  multiattnbute  nature  Ulvila  and 
Snider  [201]  illustrate  use  of  multiattnbute  utility  models  in 
negotiations. 

We  are  particularly  interested,  here,  in  describing  dcctsion- 
makmg  efforts  in  hierarchical  organizations  (241  ].  This  leads 
naturally  to  a  studv  of  information  processing  in  organizations 
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Fig.  10.  Delta  chart  on  how  lo  decide  who  should  decide  (after  (169]). 


and  a  description  of  how  decisionmakers  may  determine  informa¬ 
tion  needs.  While  there  have  been  a  number  of  studies  of  group 
decisionmaking  roles  and  organizational  behavior  [357],  (370],  our 
efforts  will  be  based  primarily  on  those  of  Vroom  and  Yetton 
(394]  and  Huber  (169], 

Huber.  Vroom.  and  Yetton  have  indicated  a  number  of  po¬ 
tential  advantages  and  disadvantages  to  group  participation  in 
decisionmaking.  Since  a  group  has  more  information  and  knowl¬ 
edge  potentially  available  to  it  than  any  individual  in  the  group, 
it  should  be  capable  of  making  a  better  decision  than  an  individ¬ 
ual.  Group  decisions  are  often  more  easily  implemented  than 
individual  decisions  since  participation  will  generally  increase 
decision  acceptance  as  well  as  understanding  of  the  decision. 
Also  group  participation  increased  the  skills  and  information  that 
members  may  need  in  making  future  organizational  decisions  On 
the  other  hand  there  are  disadvantages  to  groups  Thcv  consume 
more  time  in  decisionmaking  than  individuals.  The  decisions  mav 
not  fullv  support  higher  organizational  goals.  Group  participation 
mav  lead  to  unrealistic  anticipations  of  involvement  in  future 
decisions  and  resentment  towards  subsequent  individual  deci¬ 
sions  in  which  they  have  not  participated.  Finally,  there  is  no 
guarantee  that  the  group  will  converge  on  a  decision  alternative. 

Huber  asks  four  pnmarv  questions  the  answers  to  which 
determine  guidelines  for  selection  of  a  particular  form  of  group 
decisionmaking.  The  delta  chart  of  Fig.  10  indicates  how  the 
responses  to  these  questions  determines  an  appropriate  form  of 
group  decisionmaking  There  are  a  number  of  subsidiary  ques¬ 
tions  concerned  with  each  of  the  primary  questions.  For  example. 


we  may  determine  whether  or  not  to  involve  others  by  posing 
questions  involving  decision  quality,  understanding,  and  accep¬ 
tance,  personnel  development,  and  relationships,  and  time 
required. 

Vroom  and  Yetton  have  been  much  concerned  with  leadership 
and  decisionmaking  [394].  Their  primary  concern  is  with  effective 
decision  behaviors.  They  develop  a  number  of  clearly  articulated 
normative  models  of  leadership  style  for  individual  and  group 
decisions.  These  should  be  of  use  to  those  attempting  to  structure 
normative  or  prescriptive  models  of  the  leadership  style  portion 
of  decision  situations  which  are  capable  of  operational  implemen¬ 
tation.  We  will  not  illustrate  these  here  since  they  essentially 
involve  generalizations  of  Fig.  10.  It  is  the  apparent  goal  of 
Vroom  and  Yetton  to  move  bevond  generalities  such  as  the 
Icadc  s'p  style  theory  V- theory  >'  (211],  (394).  Thev  desire  to 
come  to  grips  with  and  explicitly  use  leadership  behavior  and 
situational  variables  to  enhance  organizational  effectiveness. 

Much  of  our  discussion  in  this  section  has  concerned  the 
evaluation  component  of  various  decisionmaking  frameworks  and 
organizational  settings  Effective  planning  and  decision  support  is 
based  not  only  upon  evaluation,  but  upon  information  acquisi¬ 
tion  and  processing  as  well.  We  have  emphasized  this  in  our 
discussions  thus  far  in  terms  of  individual  information  processing 
behavior:  but  have  not  yet  given  explicit  consideration  to  infor¬ 
mation  processing  behavior  in  organizations 

Keen  (1931  acknowledges  four  causes  of  inertia  relative  to 
organizational  information  systems.  He  indicates  that  informa¬ 
tion  is  only  a  small  component,  human  information  processing  is 
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experiential  and  relies  on  simplification,  organizational  change  is 
incremental  and  evolutionary  with  large  changes  being  avoided, 
and  that  data  is  a  political  resource  affecting  particular  groups  as 
well  as  an  intellectual  commodity.  Each  of  these  suggests  the 
importance  of  a  knowledge  of  the  way  in  which  information  is 
processed  by  organizations. 

Of  particular  interest  among  studies  concerning  information 
processing  in  organizations  arc  the  works  of  Baron  [28],  Ebert 
and  Mitchell  [89],  Fick  and  Sprague  [110],  Gerwin  and  Tuggle 
[129],  Howell  and  Fleishman  [165],  Huber  [  1 69]-[  171],  Keen 
[193],  Libbv  and  Lewis  [215],  Lucas  [225]-[228],  O’Reilly  [268], 
Shumway  ei  at.  [329],  Simon  [342],  Starbuck  and  Nystrom  [357], 
Taggart  and  Tharp  [367],  Tushman  and  Nadler  [379],  Tuggle  and 
Gerwin  [380],  Wright  [406],  and  Zedeck  [409], 

The  purpose  of  systems  for  planning  and  decision  support  is  to 
provide  timely,  relevant,  and  accurate  information  to  system 
users  such  as  to  enhance  human  judgment,  and  decisionmaking 
efficiency  and  effectiveness  concerning  resource  allocations  that 
affect  issues  under  consideration.  To  enhance  efficiency  and 
effectiveness  available  resources  must  be  allocated  and  coordi¬ 
nated  in  space,  across  a  hierarchy  of  decisionmakers:  and  in  time, 
as  new  information  arrives  and  the  environmental  situation  ex¬ 
tant  changes.  Associated  information  acquisition,  analysis,  and 
evaluation  and  interpretation  must,  as  a  consequence,  often  be 
distributed  both  in  space  and  in  time.  This  must  be  accomplished 
selectively  in  space  and  time  since  different  decisionmakers  have 
different  information  needs.  In  addition,  it  will  be  physically 
impossible  and  often  behaviorally  undesirable  to  supply  all  rele¬ 
vant  information  to  each  decisionmaker  in  the  hope  that  it  will  be 
effectively  cognized  and  utilized.  Further,  differences  in  educa¬ 
tion.  motivation,  experiences  with  the  environmental  situation 
extant,  and  stress  will  influence  cognitive  information  processing 
style.  Consequently  a  central  task  in  the  design  of  effective 
information  systems  is  that  of  selection  and  choice  of  appropriate 
information  system  architecture  to  enhance  selective  information 
processing  in  order  to  provide  each  user  of  the  system  with  the 
most  appropriate  information  at  the  most  appropriate  time.  Thus 
questions  of  information  selection,  information  aggregation  in 
space  and  in  time,  and  the  contingency  task  structure  become  of 
major  importance. 

It  is  desirable  that  an  appropriately  designed  system,  and  the 
associated  process,  be  capable  of  the  following. 

1)  Assisting  in  the  evaluation  of  alternative  plans  and  courses 
of  action  that  involve  formal  operational  thought  processes. 

2)  Assisting  in  the  transfer  of  formal  operational  situations  to 
concrete  operational  situations. 

3)  Assisting  in  evaluation  of  alternative  plans  and  courses  of 
action  that  involve  concrete  operational  thought  processes. 

4)  Assisting  in  the  avoidance  of  information  processing  biases 
and  poor  judgmental  heuristics. 

5t  Assisting  in  the  proper  aggregation  of  information  cues 
from  multiple  distributed  sources. 

6)  Assisting  in  the  use  of  a  variety  of  judgmental  heuristics 
appropriate  for  given  operational  environments  as  natural 
extensions  of  a  decisionmaker's  normal  cognitive  stvle. 

7)  Assisting,  to  the  extent  possible,  in  the  determination  <4 
whether  a  formal  or  concrete  stvle  of  cognition  is  most 
appropriate  in  a  given  situation. 

8)  Assisting  decisionmakers  who  need  to  use  formal  opera¬ 
tional  thoueht  and  those  whose  expertise  allows  appropriate 
and  effective  use  of  concrete  operational  thought  to  func¬ 
tion  together  in  a  symbiotic  and  mutuallv  supportive  wav 

(  learlv  there  is  a  space- time  and  an  organizational  dependence 
associated  wuh  these  desired  capabilities  Among  the  mans  con¬ 
cerns  ihat  dictate  needs  and  requirements  for  automated  support 
'"terns  is  the  fact  that  decisionmakers  must  typically  make  more 
judgments  and  associated  decisions  in  a  given  period  of  time  than 
thev  can  comfortably  make.  This  creates  a  stressful  situation 


which  can  lead,  as  has  been  noted,  to  the  use  of  poor  information 
processing  and  judgmental  heuristics,  especially  since  judgments 
and  decisions  are  typically  based  on  forecasts  of  the  future  and. 
therefore,  inherently  involve  uncertainty. 

There  are  formidable  needs  and  issues  to  be  resolved  that  are 
associated  with  the  design  of  information  processing  and  judg¬ 
ment  aiding  support  systems.  These  relate  to  questions  concern¬ 
ing  appropriate  functions  for  the  decisionmaker  and  staff  to 
perform.  They  concern  the  type  of  information  which  should  be 
available  and  how  this  information  should  be  acquired,  analyzed, 
stored,  aggregated,  and  presented  such  that  it  can  be  used  most 
effectively  in  a  variety  of  potential  operational  environments. 
They  concern  design  of  information  systems  with  strong  space¬ 
time-environmental  dependencies.  They  concern  design  of  infor¬ 
mation  systems  that  can  effectively  “train"  people  to  adapt  and 
use  appropriate  concrete  operational  heuristics  in  those  environ¬ 
ments  in  which  inexperience  dictates  initial  use  of  formal  opera¬ 
tional  thought.  They  concern  design  and  use  of  information 
systems  that  support  environmentally  experienced  decision¬ 
makers  in  the  use  of  a  variety  of  effective  concrete  operational 
heuristics.  And  because  of  their  use  by  multiple  decisionmakers, 
these  tasks  must  be  accomplished  in  a  parallel  architectural 
fashion. 

Huber  [  1 70]— [  171]  and  Tushman  and  Nadler  [379]  have  devel¬ 
oped  a  number  of  propositions,  based  on  their  own  research  and 
upon  the  research  of  others,  reflecting  various  aspects  of  informa¬ 
tion  processing  in  organizations.  There  are  a  number  of  funda¬ 
mental  propositions  developed  by  Tushman  and  Nadler  which 
relate  to  the  development  of  a  model  of  an  organization  as  an 
information  processing  system.  These  fundamental  propositions 
include  [379]  the  following. 

FP1:  Tasks  of  organizations  and  their  subunits  vary  in  uncer¬ 
tainty  and  risk  variables. 

FP2:  As  uncertainty  and  risk  increase  so  also  does  the  need  for 
information  and  increased  information  processing  capa¬ 
bility. 

FP3:  Capacities  and  capabilities  in  information  processing  will 
vary  as  a  function  of  organization  structure. 

FP4:  Organizational  effectiveness  increases  as  the  match  be¬ 
tween  information  processing  requirements  and  informa¬ 
tion  processing  capacity  increases. 

FP5:  Effectiveness  of  organizational  units  will  depend  upon 
their  ability  to  adapt  'heir  internal  structures  over  time 
to  meet  the  changed  information  processing  require¬ 
ments  that  will  be  associated  with  environmental  changes. 

In  an  effort  to  enhance  efficiency,  organizational  information 
processing  typically  requires  selective  routing  of  messages  and 
summarization  of  messages.  Huber  [171]  identifies  six  variables 
associated  with  the  routing  of  messages.  Six  propositions  relative 
to  message  routing  are  identified  and  associated  with  these  varia¬ 
bles.  Three  propositions  are  associated  with  delay  in  messages, 
eight  with  organizational  message  modification,  and  four  with 
message  summarization.  Table  II  presents  an  interpretation  of  the 
impacts  of  the  variables  associated  with  organizational  informa¬ 
tion  processing  and  the  probabilities  of  routine,  delav.  modifica¬ 
tion.  and  summarization  of  messages.  It  is  possible  to  infer  a  few 
impacts  not  discussed  in  this  noteworthy  work  of  Huber.  Most  of 
these  simply  relate  to  the  observation  that  if  something  happens 
to  decrease  the  probability  of  sending  a  message  unmodified  then 
the  probability  of  the  message  being  delayed  and/or  modified  is 
increased. 

Identification  of  other  variables  which  influence  information 
processing  bv  organizations  would  represent  a  desirable  activity. 
To  determine  how  these  information  processing  variables  are 
influenced  bv  ihe  information  processing  biases  of  individuals 
discussed  in  Section  111  would  seem  especially  desirable  in  terms 
of  the  hkclv  usefulness  of  the  results  and  the  need  for  an 
expanded  theory  of  group  information  processing  biases  There 
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TABLE  II 

Cross  Impact  Matrix  Between  Variables  Affecting 
Organizational  Information  and  Associated  Activities 
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appears  to  have  been  only  limited  results  obtained  in  the  area  of 
cognitive  information  processing  biases  and  use  of  inferior  heuris¬ 
tics  on  the  part  of  groups.  Thus  many  of  the  areas  discussed  in 
Sections  III  and  IV  could  be  extended  to  groups. 

Especially  noteworthy  concerning  results  that  have  been  ob¬ 
tained  in  this  area  are  the  groupthink  studies  of  Janis  and  Mann 
[  1 77]  Groupthink  is  a  collective  pattern  of  defensive  avoidance,  a 
concurrence-seeking  tendenev  of  highly  cohesive  groups.  When 
groupthink  occurs,  people  develop  rationalizations  to  support 
selectively  perceived  illusions  or  wishful  thinking  about  issues  at 
hand  and  typically  participate  collectively  in  development  of  a 
defensive  avoidance  pattern.  In  groupthink  a  group  collectively 
falls  victim  to  one  or  more  of  the  cognitive  biases  described  in 
Section  III. 

Among  the  conditions  which  lead  to  groupthink  are  high 
cohcsivencss.  insulation,  lack  of  use  of  systemic  procedures  for 


Fig.  II.  A  possible  structure  for  information  processing  based  upon  the 
six  elements  of  logical  reasoning. 


search  and  appraisal,  highly  directive  leadership,  and  a  con¬ 
tingency  task  situation  which  leads  to  high  stress.  Among  the 
symptoms  of  groupthink  cited  by  Janis  and  Mann  [177]  are  an 
illusion  of  invulnerability,  collective  rationalization,  belief  in  in¬ 
herent  group  morality,  excessive  pressure  against  dissenting  views, 
self-censorship,  illusions  of  unanimity,  and  members  who  shield 
the  group  from  disconfirming  information.  They  cite  a  large 
number  of  case  studies  involving  groupthink;  cases  where  in¬ 
crementalism  and  bureaucratic  politics  were  the  dominant  de¬ 
cisionmaking  framework  typically  adopted.  Nine  prescriptions 
are  offered  to  avoid  groupthink. 

1)  The  group  leadership  should  be  noncommitted  to  particular 
alternative  courses  of  action. 

2)  The  group  leader  should  encourage  critical  evaluation. 

3)  “Devil’s  advocates"  should  be  included  in  the  group. 

4)  Subgroups  should  be  formed,  allowed  to  function  indepen¬ 
dently,  and  then  meet  with  other  subgroups  to  express 
generated  ideas  and  resolve  differences. 

5)  A  variety  of  alternative  scenarios  of  potential  opponents 
intentions  should  be  developed. 

6)  Second-opinion  meetings  should  be  held  to  allow  full  ex¬ 
pression  of  doubts  and  rethinking  of  the  issue. 

7)  Experts  with  opposite  viewpoints  to  the  majority  view  should 
be  encouraged  to  present  challenging  views. 

8)  A  small  “policy”  subgroup  should  always  discuss  subgroup 
deliberation  with  the  larger  group  to  attempt  to  obtain 
disconfirming  feedback. 

9)  Independent  policy  planning  and  evaluation  groups  should 
be  formed. 

The  suggestions  offered  in  Section  III  to  avoid  cognitive  bias  and 
to  ameliorate  the  effects  of  those  that  do  occur  appear  capable  of 
application  to  groups  as  well  as  to  individuals.  Explicit  study  of 
group  and  organizational  bias  that  would  compliment  and  extend 
existing  studies  [16],  [19],  [129],  [155],  [173],  [257],  [276],  (279). 
[280],  [388],  [390],  [391],  [394]  of  group  and  organizational  de¬ 
cisionmaking  should  yield  results  that  are  valuable  for  the  design 
of  planning  and  decision  support  systems. 

A  major  difficulty  in  cognitive  information  processing  seems  to 
be  failure  to  identify  and  use  an  appropriate  structure  that  allows 
appropriate  weighting  of  observed  data.  Investigation  of  the 
effects  of  various  structured-information  processing,  decision  aid¬ 
ing  protocols  upon  the  acquisition,  analysis,  and  interpretation  of 
information  and  its  integration  with  judgment  and  decision- 
making  activities  would  appear  to  be  a  contcmporarv  need  in 
information  system  design.  There  are  six  elements  found  in 
explicit  argument  [376], 

1 )  claims  or  hypotheses. 

2)  grounds  or  foundations  to  support  the  claims, 

3)  warrants  or  justification  for  the  grounds  or  foundations, 

4)  hacking  or  the  general  body  of  information  that  is  presup¬ 
posed  by  the  warrant, 


TABLE  III 

Interpretation  of  the  Janis  and  Mann  [177)  Coping  Patterns 
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5)  modal  qualifiers  or  circumstances,  contingencies,  or  restric¬ 
tions  which  will  have  to  exist  in  order  that  the  warrant  truly 
supports  the  grounds. 

6)  passible  rebuttals  or  circumstances,  contingencies,  or  restric¬ 
tions  which,  if  they  exist,  will  refute  or  diminish  the  force  of 
the  warrant. 

A  simplified  block  diagram  of  the  interaction  among  these  ele¬ 
ments  is  given  in  Fig.  1 1 .  The  information  processing  "structure." 
consisting  in  part  of  the  decisionmakers’  view  of  possible  and 
probable  action  courses  and  the  “decision  situation  model.”  is 
specified  by  elements  3-6.  Element  2.  the  “grounds."  comprises 
the  situational  data  pertaining  to  the  operational  conditions 
extant.  The  claim,  element  1,  is  the  empirical  statement  which  is 
supported  by  other  elements  in  this  information  processing  struc¬ 
ture.  Toulmin  shows  through  examples  that  the  six  elements  for 
logical  argument  and  reasoning  can  be  used  as  a  model  for 
rational  reasoning  in  a  number  of  areas  including  law,  science, 
the  arts,  management,  and  ethics.  This  structured  information 
processing  model  is  also  sufficiently  general  to  accommodate 
analytical  hierarchical  inference  [165],  [306].  Thus  it  may  well 
provide  a  structured  framework  for  information  processing  that 
can  accommodate  a  variety  of  information  processing  styles  and 
approaches  ranging  from  the  purely  qualitative  and  affective,  to 
reasoning  by  analogy  which  may  be  a  blend  of  qualitative  and 
quantitative,  to  quantitatively  based  filtering  and  detection  algo¬ 
rithms.  This  could  provide  enhanced  understanding  of  the  im¬ 
plications  of  chance,  cause,  and  reason  [55]  in  human  information 
processing. 

Use  of  a  structured  information  processing  format  may  reduce 
the  tendency  for  message  distortion  due  to  the  exacerbating 
variables  presented  in  Table  III.  perhaps  to  a  considerable  extent. 
Mitroff  and  Mason  [255]  have  presented  some  suggestions  con¬ 
cerning  use  of  structured  logical  reasoning  to  cope  with  ill- 
structured  policy  problems  and  the  often  occurring  divergence 
between  opposing  formulations  and  perceptions  of  large-scale 
issues. 

Information  summarization  is  needed  in  information  systems 
for  a  variety  of  reasons.  Procedures  to  condense  and  organize 
information  into  a  form  that  can  be  managed  and  used  in  an 
efficient  manner  are.  therefore,  important.  The  structured  in¬ 
formation  processing  model  suggested  here  may  well  provide 
organizational  support  for  message  aggregation  and  integration 
that  will  accommodate  and  encourage  effective  information  sum¬ 
marization.  We  postulate  that  this  framework  may  accommodate 
both  receptive  and  preceptive  styles  of  processing  and  summari¬ 
zation  of  information,  that  it  will  also  accommodate  nonnumeri- 
cal  and  numerical  information:  and  thus  hopefully  enable  rapid 
conversion  from  one  to  the  other  as  needed  or  desired  for 
different  situations. 

In  this  section  we  have  examined  a  number  of  frameworks  for 
decisionmaking.  Our  particular  interest  is  in  the  description  of 
these  frameworks  in  a  way  compatible  with  and  supportive  of  the 
effective  design  of  systems  and  processes  to  aid  groups  in  plan¬ 
ning  and  decisionmaking.  We  describe  a  number  of  "rational" 
ways  in  which  groups  make  decisions  and  pay  particular  atten¬ 
tion  to  information  processing  needs  in  group  decisionmaking. 
Use  of  a  structured  protocol  for  information  processing  in  sys¬ 
tems  for  planning  and  decision  support  is  suggested  as  a  generic 
suggestion  of  potential  wavs  to  detect  and  correct  possible  cogni¬ 
tive  biases  that  affect  many  judgment  tasks. 
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Abstract — Aa  approach  for  choicemaking  ander  certainty,  baaed  in  part 
upon  amMple  objective  optimization,  la  presented  In  this  paper.  With  this 
approach  dearty  inferior  alternatives  are  eliminated  and  subsets  of  alterna¬ 
tives  are  determined  which  are  guaranteed  to  contain  the  moat  preferred 
alternatives  through  use  of  an  Induced  partial  order  on  the  set  of  alterna¬ 
tives.  Use  of  such  a  relation  to  order  the  alternative  set  partially  b 
remlnkent  of  muldobjcctive  optimization  theory  (MOOT).  Our  MOOT 
based  approach  is  believed  behaviorally  relevant  in  that  it  is  interactive  and 
can  accommodate  a  variety  of  cognitive  styles  and  levels  of  oo-line 
decisionmaker  preference  feedback.  It  does  not  require  elicitation  of  all 
criterion  or  attribute  weights  as  does  the  multiple  attribute  utility  theory 
(MAliT)  approach.  MAUT  is  compatible  with  and  can  be  used  to  comple¬ 
ment  and  potentially  enhance  the  effectiveness  of  the  approach  for  value 
elicitation  for  cbokemaking.  Application  of  the  MOOT  based  approach  is 
illustrated  by  several  examples. 

I.  Introduction 

THE  FOLLOWING  problem  statement  is  central  to 
many  different  choicemaking  problems  and  may  be 
compatible  with  several  decisionmaker  cognitive  styles. 

P:  select,  and  rank  to  the  extent  possible,  the  N  most 
preferred  alternatives  from  X,  the  finite  set  of  all 
alternatives  under  consideration. 

The  motivation  for  problem  P  is  due  to  the  fact  that 
decisionmakers  and  policymakers,  in  seeking  the  most 
preferred  alternative,  typically  will  first  request  a  modest 
number,  perhaps  between  three  and  five,  of  highly  pre¬ 
ferred  alternatives  from  their  analysts.  They  then  will 
explore  further  the  rationale  behind  the  selection  and 
ranking  of  these  alternatives.  The  goal  of  the  analysts, 
therefore,  is  to  provide  the  N  most  preferred  alternatives 
and  (generally)  an  explanation  of  the  rationale  behind 
their  selection  and  ranking  in  such  a  manner  that  dis- 
benefits  of  planning  and  decisionmaking  such  as  the  time, 
cost,  and  stress  of  choicemaking  are  kept  to  a  tolerably 
low  level.  We  will  assume  throughout  that  the  set  of 
alternatives  X  has  previously  been  identified  and  perhaps 
refined  with  the  aid  of  an  elimination  by  attributes  proce¬ 
dure  which  eliminates  clearly  undesirable  alternatives 
(Tversky  [10]). 
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A  standard  approach  to  solving  problem  P  is  multi¬ 
attribute  utility  theory  (MAUT)  (Keeney  and  Raiffa  [4], 
Edwards  [1]),  which  can  be  described  as  follows. 

1)  Assess  a  real-valued  (utility)  function  u,  defined  on 
the  alternative  set  X,u:X-*R,  which  satisfies  the 
property  that  the  utility  of  alternative  x  is  greater 
than  the  utility  of  alternative  x'  if  and  only  if  alter¬ 
native  x  is  preferred  to  alternative  x'\  i.e.,  u(x)> 
u(x')  if  and  only  if  x>x'.  Mathematically,  the  con¬ 
verse  is  also  true.  That  is  x>x'  if  and  only  if 
u(x)>u(x').  In  practice  we  elicit  utility  or  value 
functions  and  from  this  infer  preferences.  Behavior- 
ally  the  concept  of  preference  must  preceed  that  of 
utility. 

2)  Compute  u(x)  for  all  x&X  and  rank  order  the 
computed  utilities. 

3)  Identify  the  alternatives  that  generate  the  N  largest 
utility  values. 

There  are  conditions,1  e.g.,  mutual  utility  independence, 
which  imply  that  utility  functions  having  special  func¬ 
tional  forms,  e.g.,  the  multilinear  form,  adequately  model 
a  decisionmaker’s  preferences  (Keeney  and  Raiffa  [4]). 
Such  specialized  functional  forms  significantly  reduce  the 
amount  of  time  and  effort  required  to  complete  the  assess¬ 
ment  of  a  multiattribute  utility  function.  However,  verifi¬ 
cation  of  sufficient  conditions  to  insure  existence  of  these 
functional  forms  can  be  a  time  and  effort  consuming  task. 
Also,  if  such  sufficient  conditions  do  not  hold,  utility 
functions  with  functional  forms  based  on  these  conditions 
may  not  represent  good  quantitative  models  of  decision¬ 
maker  preference.  Finally,  the  cognitive  style  of  many 
decisionmakers  may  make  elicitation  of  the  complete  set 
of  attribute  weights  needed  for  MAUT  very  difficult. 
Thus,  although  MAUT  provides  a  solution  to  problem  P, 
accurate  execution  of  step  1)  can  be  a  time  consuming 
and  stressful  activity  in  practice,  especially  if  there  are 
many  attributes  under  consideration  and  the  decision¬ 
maker  is  not  comfortable  with  the  highly  structured  elici¬ 
tation  procedure  required  to  determine  attribute  weights. 

'Many  authors  distinguish  between  preference  (value)  functions  and 
preferential  independence  conditions  for  the  riskless  case  and  utility 
functions  and  utility  independence  conditions  for  the  risky  case.  We  use 
the  word  utility  to  represent  both  of  these. 
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In  this  paper  we  propose  a  behaviorally  attractive  com¬ 
plementary  and  alternative  approach  to  solving  problem 
P.  This  new  approach  only  attempts,  a  least  initially,  to 
order  the  alternative  set  partially.  This  is  suggestive  of  a 
search  for  the  Pareto-optimal,  .noninferior,  or  non- 
dominated  set  (or  frontier)  in  multiobjective  optimization 
theory  (MOOT).  We  therefore  refer  to  the  choicemaking 
approach  to  be  presented  and  analyzed  in  this  paper  as 
the  MOOT  based  approach.  There  have  been  a  number  of 
previous  studies  concerning  multiple  objective  optimiza¬ 
tion  theory  (Haimes  [3J,  MacCrimmon  {6],  MacCrimmon 
and  Siu  [S],  Starr  and  Zeleny  [9],  and  Zeleny  [12]).  How¬ 
ever,  our  approach  is  fundamentally  much  more  an 
evaluation,  refinement,  or  ranking  approach  than  an  opti¬ 
mization  approach. 

The  primaiy  advantage  of  at  least  initially  assessing 
only  a  partial  order  on  the  alternative  set  is  that  the  often 
difficult  and  time  consuming  effort  of  trading  off  non- 
commensurate  objectives,  or  attributes,  may  be  partially 
avoided.  Avoidance  or  delay  in  making  trade-offs  will 
eliminate  or  at  least  postpone  explication  of  those  values 
and  goals  that  the  decisionmaker  may  wish  to  leave  ini¬ 
tially  implicit.  The  disadvantage  of  a  partial  order  is  that 
the  resulting  nondominated  set  of  alternatives  will  con¬ 
tain,  in  general,  more  than  one  alternative,  thereby  requir¬ 
ing  further  effort  for  final  choice  selection.  The  reason  for 
determining  the  partial  order,  however,  is  that  if  the 
nondominated  set  is  sufficiently  small,  the  decisionmaker 
may  be  able  to  select  the  most  preferred  alternative  from 
the  nondominated  set  without  any  significant  further  ex¬ 
ternal  assessment.  Equivalently,  the  partial  order  can  be 
thought  of  as  eliminating  dominated  alternatives  from 
further  consideration.  We  remark  that  since,  for  example, 
the  second  most  preferred  alternative  may  not  be  in  the 
original  nondominated  set,  determination  of  only  the 
original  nondominated  set  is  not  guaranteed  to  solve 
problem  P. 

The  MOOT  based  approach  to  solving  problem  P  is 
presented  in  Section  II.  The  key  assumption  made  is  that 
the  decisionmaker  can  select  the  most  preferred  alterna¬ 
tive  from  any  given  set  of  nondominated  alternatives.  This 
assumption  is  referred  to  as  the  complete  preference  feed¬ 
back  assumption.  Three  procedures  are  offered  for  en¬ 
hancing  the  likelihood  that  the  complete  preference  feed¬ 
back  assumption  will  hold. 

An  algorithm  for  solving  problem  P  for  the  complete 
preference  feedback  case  and  an  example  are  presented  in 
Section  III.  Our  development  of  this  algorithm,  presented 
in  Section  IV,  is  based  on  use  of  a  directed  graph  repre¬ 
sentation  of  the  partial  order  on  the  set  of  alternatives  X 
induced  by  a  vector  of  objective  functions. 

In  Section  IV  we  modify  the  statement  of  problem  P 
and  the  associated  analysis  to  accommodate  the  possibil¬ 
ity  that  complete  preference  feedback  may  not  be  availa¬ 
ble.  An  algorithm  and  several  examples  are  presented  for 
this  partial  preference  feedback  case. 

A  rather  complete  hypothetical  example  is  presented  in 
Section  V  to  illustrate  several  of  the  notions  developed 
earlier. 


II.  The  Moot  Based  Choicemaking  Approach — 
Complete  Preference  Feedback 

In  this  section  we  present,  discuss,  and  analyze  the 
MOOT  based  approach  to  solving  problem  P.  We  make  a 
complete  preference  feedback  assumption:  that  the  de¬ 
cisionmaker  can  choose  the  most  preferred  alternative 
from  any  given  nondominated  set.  Procedures  are  sug¬ 
gested  for  improving  the  likelihood  that  this  assumption 
will  hold.  This  section  begins  with  several  preliminary 
definitions  and  assumptions. 

We  assume  that  M  presumably  noncommensurate 
attributes  have  been  identified  and  that  for  each  attribute 
m,  a  real-valued  objective  function  on  X,vm:X-*R,  has 
been  assessed.2  For  the  mth  attribute,  vm  is  equivalent  to  a 
total  order,  on  X;  i.e.,  x'  is  preferred  to  x  with 
respect  to  the  mth  attribute  (x<mx')  if  and  only  if  wm(x) 
<»„(*')• 

Although  the  MOOT  based  approach  to  choicemaking 
presented  in  this  paper  requires  M  objective  functions  to 
be  assessed,  compared  to  only  one  utility  function  to  be 
assessed  for  the  MAUT  approach,  assessment  of  the  com¬ 
plete  set  of  lowest  level  objectives  {«,}  is  often  signifi¬ 
cantly  easier  than  complete  assessment  of  u.  Typically, 
assessment  of  a  complete  scalar  utility  function  will  re¬ 
quire  assessment  of  M  lowest  level  component  utility 
functions  c,  or  i  =  1,2,-  ■  •  ,M,  and  trading  off  all  of 
these  utility  functions  by  assessing  at  least  M-  1  utility  or 
attribute  weights.  Assessment  of  { v, }  for  the  MOOT 
based  approach  does  not  require  trading  off  the  M  lowest 
level  noncommensurate  objectives,  an  activity  that  utility 
function  assessment  cannot  avoid.  For  example,  few 
would  disagree  that  1)  maximizing  economic  benefit  and 
2)  minimizing  environmental  pollution  are  two  important 
objectives  in  the  management  of  many  industrial  innova¬ 
tion  situations.  It  is  unlikely  that  determining  objective 
measure  functions  for  these  two  objectives  would  be  un¬ 
duly  time  consuming,  stressful,  or  controversial.  Trading 
off  achievement  levels  for  these  two  objectives,  however, 
may  be  agonizing.3  To  the  extent  possible,  it  may  be 
desirable  to  avoid,  or  at  least  postpone,  making  such 
trade-offs,  especially  if  they  are  not  really  necessary,  as 
may  often  be  the  case. 

Let  the  vector  function  v:X-*R M  be  defined  as  e(x)  = 
{o,(x),-  •  ■  ,cM(x)}.  Note  that  v  is  equivalent  to  a  partial 
order  on  X\  i.e.,  x  is  preferred  to  x  (x<x')  if  and  only  if 
ti(x)  <  e(x').  Let  v(X)  =  (u(x) :  x  €  .V),  and  assume 
without  significant  loss  of  generality  that  t> :  ,V— »t-(.V)  is 
one-to-one  and  onto.  The  A/-vector  element  h’£c(.Y)  and 
its  corresponding  alternative  are  said  to  be  nondominated 
if  there  does  not  exist  another  element  ir'ei’fY)  such  that 
w  <  w'  and  w*=w'. 

The  MOOT  based  choicemaking  approach  for  solving 
problem  P  consists  of  two  basic  steps. 

JFor  notational  convenience  we  will  use  t>,  to  represent  attnbules  and 
objectives  for  the  MOOT  based  approach  and  u,  to  represent  attributes 
for  the  MAUT  based  approach. 

’Generally,  practical  determination  of  objecuve  measure  functions 
requires  preference  independence  among  objectives,  a  requirement  com¬ 
mon  to  both  MAUT  and  our  MOOT  based  approach. 
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1'  Select  the  most  preferred  element  in  v(X)  from  the 
nondominated  set  of  v(X),  i.e.,  the  set  of  all  non- 
dominated  elements  in  v(X ). 

2'  If  the  number  of  alternatives  determined  thus  far  is 
less  than  N,  say  S’,  then  redefine  X  as  X  with  these 
S’  alternatives  removed  and  go  to  1);  otherwise  stop. 

We  now  discuss  several  important  issues  raised  by  each  of 
these  two  steps. 

A)  Step  I’ 

Two  fundamental  assumptions  must  hold  in  order  that 
Step  1'  can  be  successfully  accomplished: 

a)  the  most  preferred  element  in  v(X)  can  be  found  in 
the  nondominated  set  of  v(X); 

b)  the  decisionmaker  can  select  the  most  preferred  ele¬ 
ment  in  the  nondominated  set  of  v(X).  This  is  the 
complete  preference  feedback  assumption. 

We  remark  that  it  is  particularly  desirable  for  the  first 
assumption  to  hold  since,  in  general,  the  fewer  the  alterna¬ 
tives  the  decisionmaker  has  from  which  to  choose,  the 
easier  it  is  to  select  the  most  preferred  alternatives.  We 
will  show  that  the  first  assumption  holds  under  a  weak 
and  behaviorally  relevant  hypothesis,  which  will  be  pre¬ 
sented  after  a  needed  definition. 

Definition:  A  scalar  sociai  choice  function  is  a  function 
V:v{X)->R  which  when  composed  with  the  objectives 
function  v  produces  the  utility  function  u;  i.e.,  V  is  such 
that  u(jc)—  V[v(x)\  for  all  x€.X. 

The  scalar  social  choice  function  trades  off  the  objec¬ 
tives  functions  to  produce  a  real-valued  measure  of  prefer¬ 
ence.  In  our  approach,  we  wish  to  avoid  a  complete 
explicit  assessment  of  V  as  much  and  for  as  long  as 
possible.  To  verify  that  it  is  sufficient  to  examine  only 
elements  in  the  nondominated  set  of  o(Jf)  in  searching  for 
the  most  preferred  element  in  t?(AT),  however,  we  must 
assume  its  existence. 

Lemma  I:  Assume  that  the  social  choice  function  V  is 
isotone  (monotonically  nondecreasing).  Then,  there  is  a 
vector  element  w  in  the  nondominated  set  of  v(X)  such 
that  V( iv) >  y(tv’)  for  all  w'6t(Jf). 

Proof:  Assume  that  there  is  a  wG.v(X)  which  is  not 
in  the  nondominated  set  of  v(X)  but  which  has  the 
property:  V(  w)  >  V(  w)  for  all  h>  in  the  nondominated  set 
of  i(  V ).  This  property  implies  that  for  all  w  in  the 
nondominated  set  of  e(.V):  hence,  w  is  a  member  of  the 
nondominated  set  of  i-(.V),  which  is  a  contradiction. 

In  light  of  Lemma  1.  we  therefore  assume  throughout 
the  remainder  of  this  paper  that  the  social  choice  function 
is  isotone  in  the  value  function  in  order  to  preserve  the 
isotonicity  of  the  utility  function  u  with  respect  to  the 
partial  ordering  induced  by  v  on  .V. 

We  remark  that  if  mutual  utility  independence  (Keeney 
and  Raiffa  [4])  holds,  then  the  multiplicative  form  of  nsk 
preference  or  utility  under  nsk 

l  +  ATufr)-  f]  [1 +  **„«„(*)] 
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represents  a  special  case  of  an  isotone  social  choice  func¬ 
tion. 

The  primary  difficulty  in  successfully  accomplishing 
Step  1'  is  that  the  decisionmaker  may  not  be  able  to  easily 
select  the  most  preferred  element  in  the  nondominated  set 
of  v(X),  i.e.,  the  complete  preference  feedback  assumption 
may  not  be  valid,  in  general.  The  ease  with  which  this 
selection  can  be  made  depends  on  the  specific  decision 
situation,  the  efficiency  of  the  attribute  or  objective  struc¬ 
turing  procedure,  the  number  of  attributes,  and  the  cogni¬ 
tive  style  of  the  decisionmaker  and  decision  situation 
associated  task  characteristics. 

In  some  case-  the  nondominated  set  of  v(X)  may  be 
sufficiently  small  and/or  its  alternative  elements  may  be 
sufficiently  distinguishable,  and/or  the  dimension  of  the 
objectives  vector  v  may  be  sufficiently  small  for  the  de¬ 
cisionmaker  to  select  the  most  preferred  alternative 
without  further  preference  elicitation.  For  example,  a  re¬ 
cently  developed  medical  diagnostic  decision  aid,  which 
uses  a  specialized  and  simplified  version  of  the  MOOT 
based  approach,  typically  provides  a  nondominated  di¬ 
agnostic  test  set  which  is  sufficiently  small  to  cause  a 
physician  little  difficulty  in  selecting  a  test  from  the  non¬ 
dominated  set  without  further  explicit  preference  elicita¬ 
tion  (White  et  al.  [II]).  If  this  is  not  the  case  and  the 
decisionmaker  finds  it  difficult  to  select  a  most  preferred 
alternative  from  the  nondominated  set  of  v(X),  two  ap¬ 
proaches,  not  requiring  complete  preference  elicitation, 
can  be  considered. 

a)  Decrease  the  size  of  the  nondominated  set  until  it  is 
small  enough  for  the  decisionmaker  to  be  able  to 
select  a  most  preferred  alternative. 

b)  Modify  problem  statement  P  and  the  desired  end 
result  of  the  analysis  in  order  to  accommodate  the 
fact  that  complete  preference  feedback  is  not  availa¬ 
ble. 

The  second  approach  will  be  considered  in  detail  in 
Section  IV  and  will  not  be  discussed  further  in  this  sec¬ 
tion.  We  devote  the  remainder  of  this  section  to  the  first 
approach. 

There  appears  to  be  three  potentially  implementable, 
general  procedures  to  accomplish  the  first  approach: 

1)  trading  off  objectives  such  as  to  reduce,  in  effect,  the 
number  of  objectives  by  moving  up  the  objectives 
tree. 

2)  determining  bounds  on  the  objective  trade-off 
weights, 

3)  utilizing  prior  elicited  knowledge  concerning  the 
functional  form  of  the  social  choice  function. 

The  first  procedure  results  in  trading  off  some  of  the 
objectives.  This  is  equivalent  to  redefinition  of  some  lower 
level  objectives  in  terms  of  higher  level  objectives  and.  in 
this  way,  “moving  up”  the  objectives  tree.  Following 
several  preliminary  definitions,  we  will  show  that,  under 
proper  assumptions,  trading  off  some  of  the  objectives  is  a 
generally  desirable  activity,  especially  where  there  are 
many  lowest  level  objectives.  Trading  off  some  of  the 
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objectives: 

a)  “strengthens”  the  induced  partial  order 

b)  does  not  add  elements  to  the  set  of  nondominated 
elements  and  often  results  in  a  reduction  in  the 
number  of  elements  in  the  nondominated  set. 

Let  6:X-*Rn,N  <M,  be  defined  as  »(x)=/[t)(x)]  for 
all  xEX,  where  /:  Let  <  be  the  partial  order 

on  X  induced  by  «5.  Define  X  and  X  as  the  nondominated 
sets  in  X  generated  by  the  respective  partial  orders  -<  and 
■<. 

We  remark  that  the  function  /  can  represent  a  social 
choice  function  (if  it  is  isotone  and  if  N=  1)  or  a  function 
that  trades  off  less  than  all  of  the  objectives  functions.  For 
example,  let  /(*v„-  •  ■  ,wltl)=  {w„-  •  •  ,wM_2,g(wM_ltwM)) 
ERm  where  the  function  g :  R2-*R 1  represents  a  (pre¬ 
sumably  isotone)  “local”  social  choice  function  of  the  two 
objectives  functions  wM_ ,  and  wM.  The  function  /  can 
also  delete  some  of  the  objectives  from  consideration  (let 
/(w,,- ■  •  ,h’a/)=  {w,,- •  •  ,wN],  where  N<M).  See  (Fish- 
burn  [2])  for  a  relat «.!  discussion  which  involves  lexico¬ 
graphic  ordering.  Deletion  of  objectives,  however,  appears 
best  accomplished  as  part  of  the  prescreening  and  pre¬ 
scanning  of  alternatives,  or  alternatives  refinement  step, 
which  would  precede  the  use  of  the  MOOT  based  proce¬ 
dure. 

Lemma  2: 

a)  If  /  is  isotone,  then  for  any  pair  x,x'€A\  the  fact 
that  x<x'  implies  x-<x'. 

b)  If  /  is  strictly  isotone,  then  X  C  X. 

Proof:  We  note  that  x<x'  if  and  only  if  u(x)<t>(x') 
which  implies  u(x)=/[t;(x)] </[c(x')]  =  v(x')  if  and  only 
if  x<x’.  Thus  part  a)  is  shown  to  be  correct. 

_To  verify  the  correctness  of  part  b)  we  will  prove  that 
Xc  cXc,  where  the  superscript  c  stands  for  complementa¬ 
tion  with  respect  to  X.  Let  xEXr.  Then  there  exists  an 
x' EX  such  that  u(x)<u(x')  and  ufxj^cfx').  The  strict 
isotonicity  of  /  preserves  this  property  under  composi¬ 
tion.4  Hence,  c(x)=/[c(x)]</[t;(x')]  =  i>(x')  and  ^(x)^ 
v(x'),  which  implies  x  &  X. 

Part  a)  of  Lemma  2  states  that  if  alternative  x'  is 
preferred  to  alternative  x  before  a  trade-off  is  made,  then 
this  preference  will  also  hold  after  the  trade-off  is  made. 
Clearly  the  converse  may  not  be  true;  for  example,  let 
h>=*(1,2),  h',  =  (2,  1),  and  f(y»)  =  wx.  Thus,  a  trade-off  will 
always  "strengthen"  (more  properly,  not  weaken)  a  partial 
ordering  on  X  (and  -<  is  said  to  be  stronger  than  <)  in 
that  there  will  be  at  least  as  many  pairs  of  alternatives 
having  elements  that  can  be  related  by  -<  as  could  be 
related  by  <. 

Part  b)  of  Lemma  2  states  that,  under  the  assumption 
that  the  trade-off  function  is  strictly  isotone,  the  set  of 
nondominated  alternatives  resulting  from  a  trade-off  will 
never  contain  more  alternatives  than  before  the  trade-off 
was  made.  This  is  desirable  since  a  decisionmaker  would 
not  want  to  spend  the  time  and  effort  involved  in  trade¬ 


off  elicitations  if  this  were  to  result  in  an  increased  num¬ 
ber  of  alternatives  to  be  considered.  We  remark,  however, 
that  strict  isotonicity  is  required.  For  example,  if  /(  h>)»  1 
for  all  h>€  0(20,  then  X  =  X. 

The  procedure  of  making  trade-offs  may  be  accom¬ 
plished  by  the  use  of  an  attribute  or  objectives  measure 
template,  or  tree,  the  structure  of  which  is  generally  ob¬ 
tained  as  part  of  the  impact  assessment  and  analysis  phase 
of  a  choicemaking  effort.  As  has  been  demonstrated  by 
Lemma  2,  moving  up  the  objectives  template  by  increas¬ 
ing  the  number  of  objectives  traded  off  will  not  increase 
the  size  of  the  nondominated  set.  It  is  therefore  beneficial 
to  perform  as  many  attribute  or  objectives  trade-offs 
initially  as  is  comfortably  possible  (i.e.,  make  the  number 
of  objectives  M  as  small  as  is  comfortably  possible). 
Trading  off  all  of  the  objectives  (through  use  of  an 
assessed  social  choice  function  which  may  be  an  ap¬ 
proximation  based  on  ordinal  preference  data  or  a  func¬ 
tion  based  on  a  complete  cardinal  preference  assessment) 
is  mathematically,  though  not  necessarily  behaviorally, 
equivalent  to  assessing  a  utility  function  and  would  pro¬ 
duce  a  nondominated  set  consisting  of  only  the  most 
preferred  alternative. 

The  second  procedure  to  decrease  the  number  of  ele¬ 
ments  in  the  nondominated  set  of  t>(20  involves  determin¬ 
ing  bounds  on  the  objective  trade-off  weights.  This  proce¬ 
dure  would  impose  at  least  a  partial  ordering  on  the 
alternatives  within  a  nondominated  set.  Fot  example,  con¬ 
sider  the  following  M  =  2  case.  The  isotonicity  of  a  social 
choice  function  guarantees  that  if  an  equipreference  curve 
goes  through  the  point  w  in  Fig.  1,  then  the  remainder  of 
the  curve  will  be  in  the  shaded  area.  Therefore,  the 
isotonicity  of  the  social  choice  function  does  not  provide 
sufficient  information  to  determine  how  the  points  w  and 
w'  are  related  by  preference.  If,  however,  it  could  be 
determined  that  the  equipreference  curve  would  remain  in 
the  shaded  region  depicted  in  Fig.  2,  then  we  would  be 
assured  that  w  is  preferred  to  w'.  For  example,  if  the 
decisionmaker  can  state  that  the  weight  of  objective  2  can 
never  exceed  a  times  the  weight  of  objective  1  and  that 
a>(wl  — w\)/(w~- w2),  then  we  can  surely  assume  that  n> 
is  preferred  to  h>'. 

The  third  procedure  for  reducing  the  number  of  ele¬ 
ments  in  the  nondominated  set  of  u(A')  requires  utilizing 
what  information  there  exists  regarding  the  functional 
form  of  the  social  choice  function  V.  For  example,  assume 
V  is  linear  in  the  objectives  functions:  hence  the 
equipreference  curves  are  lines  having  negative  slope  as  in 
Fig.  3.  Consider  three  alternatives  x,,  x?.  and  x3.  each 
producing  objective  vectors.  i>(x,).  of  (0.1),  (1.0),  and 
(0.4, 0.4).  respectively.  Clearly,  all  three  alternatives  are 
nondominated:  however,  it  is  easy  to  demonstrate  that  the 
linearity  of  V  implies  that  alternative  x3  can  not  be 
preferred  to  both  x,  and  x2. 

Step  2' 

Once  an  alternative  has  been  determined  as  most  pre¬ 
ferred  in  Step  I',  Step  2'  requires  that  this  alternative  be 
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Fig.  I.  Bounds  on  equipreference  curves. 
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Fig.  2.  Reduced  region  for  equiprefcrence  curves. 


Fig.  3.  Dominated  and  nondominated  alternatives. 


removed  from  further  consideration.  Even  though  the 
most  preferred  alternative  must  be  in  the  nondominated 
set,  the  second  most  preferred  alternative  may  not  be.  Fig. 
3  illustrates  this  fact,  which  is  very  important  in  practice 
for  successful  use  of  multiple  objective  based  approaches. 

III.  Algorithm  for  the  Complete  Preferenc  e 
Feedback  Case 

Following  some  preliminaries,  we  present  an  algorithm 
in  this  section  for  determining  the  ;V  most  preferred 
alternatives  and  their  ranking  from  a  finite  set  of  alterna¬ 
tives.  This  algorithm  assumes  that  the  decisionmaker  can 
always  identify  the  most  preferred  element  from  any  given 
nondominated  set. 

The  algorithm  for  the  complete  preference  feedback 
case  as  well  as  one  other  algorithm  to  be  presented  in 
Section  IV,  will  be  based  on  a  directed  graph,  or  digraph. 


Fig.  5.  Initial  digraph  for  the  example:  contextual  relation  "dom¬ 
inates.** 

constructed  using  the  contextual  relation  “dominates.” 
Details  of  the  construction  of  such  digraphs  are  given  in 
{8]  and  elsewhere.  We  now  present  an  example  in  order  to 
illustrate  the  relationship  between  a  set  efA-)  and  its 
associated  digraph. 

Example:  I:  Assume  M  =  2  and  that  i?( X)  is  composed 
of  the  following  points,  where  **',  =  {  w, , ,  wf 2 } : 

h-,»(11,10) 

h-2«(9,II) 
h»j  =  (12,4) 
h-„  =  (8.8) 

h>s  =  (5.9) 

-7  =*(7. 2). 

These  points  are  displayed  in  Fig.  4;  the  associated  di¬ 
graph  is  presented  in  Fig.  5. 

Consider  the  following  algorithm. 

0)  Set  n  =  1 . 

1)  Determine  the  most  preferred  element  in  the  top 
level  set  (or  nondominated  set)  of  the  digraph.  This 
is  equivalent  to  determining  the  nth  most  preferred 
alternative. 

2)  Remove  the  selected  element  from  the  digraph. 
Move  up  to  the  top  level  all  second  level  elements 
which  were  predecessors  of  onlv  the  removed  ele¬ 
ment. 

3)  If  n  =  N  stop;  if  not.  increase  n  bv  one  and  go  to  step 

1). 

We  illustrate  the  above  algorithm  with  the  following 
example. 
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Example:  2:  Assume  that  A»  {*,,•  •  •  ,jc7}  and  h>  « 
t>(x,),  /  -  1  ,•  •  • ,  7,  as  given  in  Example  1  and  depicted  in 
Fig.  4  and  5.  We  note  from  Fig.  5  that  search  for  the  most 
preferred  alternative  can  be  restricted  to  those  represented 
by  {h»,,h»2,h>3}  (or  equivalently  alternatives  {jc,,x2,Xj}); 
consequently,  the  decisionmaker  can  ignore  the  elements 
h >/,  /  =»  4,  •  •  • ,  7,  in  selecting  the  most  preferred  alternative. 
Assume  that  the  decisionmaker  selects  jc,  as  the  most 
preferred  alternative.  We  then  eliminate  w,  to  produce 
Fig.  6.  Observe  that  altho’  ^h  elements  h>4  and  h>3  are  no 
longer  dominated  by  *v,  (which  is  now  removed),  they 
remain  dominated  by  w2,  and  hence  no  new  elements 
move  into  the  nondominated  set.  A  search  for  the  second 
most  preferred  element  can  therefore  be  restricted  to  the 
set  {h^Wj}.  Assume  the  decisionmaker  selects  h>2  as  the 
second  most  preferred  score.  Removal  of  h>2  from  Fig.  6 
now  allows  wA  and  wi  to  enter  the  nondominated  set,  as 
shown  in  Fig.  7.  A  search  for  the  third  most  preferred 
element  in  e(A)  can  therefore  be  restricted  to  the  set  of 
attribute  or  objective  scores  h>5)  and  the  alterna¬ 

tives  x3,  x4,  and  xs  that  they  represent. 

IV.  The  Partial  Preference  Feedback  Case 

As  discussed  in  Section  II,  the  complete  preference 
feedback  assumption  may  not  always  be  satisfied  without 
making  difficult  trade-offs  to  insure  a  sufficiently  small 
dimension  for  the  objectives  vector  and  sufficiently  small 
size  of  the  nondominated  set.  In  order  to  be  able  to 
accommodate  the  possibility  that  complete  preference 
feedback  may  not  be  available,  we  modify  the  statement 
of  problem  P  as  follows. 

P':  determine  %N,  a  collection  of  ordered  subsets  of  A, 
where 

1)  each  element  in  %N  contains  V  alternatives, 

2)  each  element  in  %N  is  a  candidate  for  the  ordered 

set  of  the  N  most  preferred  alternatives  based  on: 

a)  the  digraph  induced  by  the  vector  func¬ 
tion  v 

b)  preferences  additional  to  those  already  expressed 
in  determining  the  vector-valued  function  r. 

We  remark  that  although  the  information  contained  in 
%v  's  of  obvious  value  for  decisionmaking,  “Xy  may  not 
be  the  most  desirable  form  in  which  to  present  this  infor¬ 
mation.  A  desirable  aggregated  form  might  be  AyCA. 
where  Ay  is  the  subset  that  is  guaranteed  to  contain  the  N 
most  preferred  alternatives.  The  subset  Ay  is  easily  ob¬ 
tained  by  taking  the  union  of  subsets  in  A  v.  Observe  that 
in  general  \'v  cannot  be  reconstructed  from  A'v  and  the 
digraph  because  of  the  additional  preference  information 
supplied  by  the  decisionmaker.  It  is  true,  however,  that 
-X.v  is  a  subset  of  the  set  of  all  combinations  of  alterna¬ 
tives  in  Av  which  are  compatible  with  the  original  di¬ 
graph. 

We  observe  that  any  subset  of  X  having  cardinality  n 
(i.e.,  containing  n  elements)  may  not  be  a  member  of  V\„. 
For  example,  {x,,x2,x7)  cannot  be  a  member  of  X  3  for 


the  set  of  alternatives  considered  in  Examples  I  and  2 
because  it  is  incompatible  with  the  digraph  displayed  in 
Fig.  5;  i.e.,  the  digraph  indicates  that  x7  cannot  be  the 
third  most  preferred  alternative. 

Lemma  2b)  demonstrated,  for  the  complete  preference 
feedback  case,  that  trading  off  objectives  would  not  cause 
additional  alternatives  to  be  included  in  the  non¬ 
dominated  set.  We  now  prove  an  analogous  result  for  the 
partial  preference  feedback  case,  following  several  pre¬ 
liminary  definitions.  Let  XN  be  the  collection  of  ordered 
subsets  of  X  which  is  defined  as  %N  is  defined,  except  "Xy 
is  determined  based  on  a  partial  order  ■<  that  is  stronger 
than  <.5  Similarly,  we  define  XNcX  as  the  union  of  all 
subsets  of  X  in  “Xy . 

Corollary:  Assume  that  the  function  /  defined  in  Sec¬ 
tion  II  is  strictly  isotone.  Then,  ^Xv  c  uXy  and  Av  c  Ay. 

Proof:  Clearly,  Ay  c  XN  if  jXv  c  ""Xv.  Lemma  2b)  im¬ 
plies  that  '?C|C"X|;  assume  X„.|CX,.|.  It  is  easily 
shown  that  Lemma  2b)  then  implies  \X„  C  “X„,  and  the 
result  follows  by  induction. 

An  algorithm  for  the  determination  of  vXy  is  as  follows. 

0)  Set  '!XO  =  0  and  1. 

1)  Assume  ?C„_i  •  •  ,X?_ ,}  and  uXn=0;  set 

A-l. 

2)  Construct  a  digraph  from  the  alternatives  in  A— 

6 

An-  I* 

3)  Assume  there  are  L  nondominated  alternatives  in 
the  digraph  constructed  in  step  2).  Set  /=  1. 

4)  Let  Y  =  ( A *_ , , x ) ,  where  rSA  is  the  /th  non¬ 
dominated  alternative  in  the  digraph  constructed  in 
step  2). 

5)  Determine  whether  or  not  the  set  KcA  should  be 
included  in  \X„  and  include  it  or  exclude  it  as 
appropriate.  This  determination  should  result  from 


’Refer  to  Section  II  for  further  explication  of  these  sets  and  subsets. 

AC\Bc\  that  is,  A~B  is  the  set  of  all  points  in  A  which  are 
not  also  contained  in  B. 
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either  direct  interaction  with  the  decisionmaker  or 
from  preference  information,  additional  to  the  infor¬ 
mation  contained  in  the  function  u,  obtained  from 
the  decisionmaker. 

6)  If  /  >  L,  go  to  7).  If  l<L ,  let  /=»/+!  and  go  to  4). 

7)  If  k  >  K,  go  to  8).  If  k  <  K,  let  k  -  k  + 1  and  go  to 
2). 

8)  If  n  >N,  stop.  If  n  <N,  let  n=  n  + 1  and  go  to  1). 

We  can  now  demonstrate  that  problem  P'  generalizes 
problem  P  for  the  case  of  complete  preference  feedback. 
Observe  that  complete  preference  feedback  would  select 
X ,  to  be  composed  of  one  subset.  This  subset  would 
contain  only  one  alternative,  the  most  preferred  alterna¬ 
tive.  We  assume  X„_,  contains  only  one  ordered  subset 
of  X  which  contains  the  n  —  1  most  preferred  alternatives. 
Then,  a  quick  iteration  of  the  algorithm  indicates  that  step 
5)  determines  the  nth  most  preferred  alternative  which  is 
included  with  the  subset  of  X„_,  to  result  in  the  single 
subset  contained  in  X„  for  this  complete  preference 
feedback  case. 

The  following  four  examples  illustrate  the  MOOT  based 
choicemaking  algorithm  for  the  partial  preference  feed¬ 
back  case  and  several  forms  of  the  partial  preference 
information  that  may  be  available  from  the  decision¬ 
maker. 

Example  3:  Consider  the  set  of  alternatives  and  their 
objective  measures  which  were  examined  in  Examples  1 
and  2.  We  will  assume,  however,  that  the  decisionmaker 
can  supply  no  preference  feedback  beyond  the  preference 
information  already  contained  in  the  function  c.  This 
assumption  is  the  opposite  extreme  of  the  complete  prefer¬ 
ence  feedback  case  and  will  be  referred  to  as  the  no 
preference  feedback  case.  Note  that  step  5)  in  the  above 
partial  preference  feedback  algorithm  is  essentially  re¬ 
moved  in  this  case.  Thus, 

2  =  {  {  -<  !<■ *2  }  •  {  *1-  *3  }  •  {  Tj.  -V ,  }  ,{  Xj.  Xj  }  {  X,.  X ,  }  , 

{Xj.X,}  }. 

iXj={{x,.x2.Xj}.{x1.x,,x4}.{xl.x2.x5}.{xI.x,,X2). 

{x2.x1.xj}.{x2.x,.x4}.{x2.x„x5}.{x2.x,.xl}. 

{Xj,X,.X,}.{  Xj.Xj.X,}} 

as  can  easily  be  seen  by  inspection  of  Fig.  5.  We  note  that 
.V|  =  {x,.x2.x3} 

.V2={x,.x,,x,} 

.V3={x1.x2.xj.x4.x,}. 

It  is  of  interest  to  observe  that  if  the  first  three  most 
preferred  alternatives  are  sought,  then  alternatives  x„  and 
t-.  can  always  be  excluded  from  consideration,  even  if  no 
preference  feedback  is  available  from  the  decisionmaker. 

We  remark  that  for  the  no  preference  feedback  case  Xv 
can  be  reconstructed  exactly  from  ,Vv  and  the  original 
digraph. 

Example  4  Assume  that  in  examining  the  results  of 
Example  3.  the  decisionmaker  decides  that  x4  cannot  be  a 


Fig.  8.  Piefeiences  and  domination  relations  for  linear  social  choice 
function. 


member  of  Xy  Then,  %  3  becomes 

^C,-{{X„X2,X3},{X„X2,X5},{X„X3,X2},{X:,X|,X3}, 
{x2,x„x5}. {xj.Xj.x,}, {x3,x„x2}.{x3, x2.x,}}. 

Example  5:  Assume  that  the  decisionmaker  cannot  ex¬ 
clude  any  of  the  original  three  nondominated  alternatives 
as  the  most  preferred  alternative,  given  only  the  informa¬ 
tion  provided  in  Examples  1  am'  2.  That  is,  °X ,  = 
{{x,},{x2}.{x3}}.  For  the  rt  =  2  case,  however,  we  assume 
that  the  decisionmaker  feels  that  both  x,  and  x2  cannot  be 
more  preferred  than  x3,  or  equivalently  that  x3  must  either 
be  preferred  to  x,  or  to  x2.  Therefore, 

2  *  {  {  X  |»  Xj  }  ,  {  Xj,  X,  }  ,  {  Xj,  X |  } »  {  Xj,  x2 }  }, 

which  is  ider  :ical  to  the  X  2  determined  in  Example  3 
with  the  sets  (x,,x2)  and  {x2,x,}  excluded.  If  no  further 
preferences  can  be  expressed,  it  then  follows  that 

*3“  {{XpXj.X,}.  {Xj.Xj.X,  }.{x3,x,.x2},{x3,x2.xl}}. 

Thus,  —  T2- .Yj» {x,,x2,xj}.  We  now  observe  that 
alternatives  x,.  i  —  4,  •••  ,7,  can  be  excluded  from  consider¬ 
ation  in  determining  the  three  most  preferred  alternatives. 
x6  and  x7  were  already  excludable:  the  information  that 
both  alternatives  x,  and  x2  cannot  be  more  preferred  than 
Xj  allows  us  to  exclude  x4  and  x5  from  consideration  as 
candidates  for  the  three  most  preferred  alternatives.  Note 
that  this  exclusion  has  been  accomplished  without  de¬ 
tailed  elicitation  of  weights. 

Example  6:  Again  consider  the  data  presented  in  Ex¬ 
amples  I  and  2.  Assume  preference  information  from  the 
decisionmaker  has  implied  that  the  three  most  preferred 
alternatives  are  x,.  x2,  and  x4  and  that  the  social  choice 
function  is  linear.  Let  c(.v)=  { c,(x).r2(x)}  and  assume 
that  the  social  choice  function  is  F[t(x)]=» ac,(x)  + 
c2(x),a>0.  We  can  easily  obtain  the  preference  or 
domination  digraph  of  Fig.  8.  Since  we  have  assessed  that 
X3  «  { { x,,x2.x4} },  we  see  from  Fig.  8  that  }<a<l.  It 


322 


IEEE  TRANSACTIONS  ON  SYSTEMS,  MAN,  AND  CYBERNETICS,  VOL.  SMC-IO,  NO.  6,  JUNE  1980 


also  follows  without  further  preference  information  that 
“  {{*!•  x2<  x*y  -*2-  -*4*  *5}}-  Note  that 

{x„x2,x4,jc4}  €9t4  due  to  the  linearity  of  the  social  choice 
function  even  though  x6  is  in  the  nondominated  set  of  X 
with  alternatives  jclt  x2,  and  jc4  removed.  Thus  we  see  that 
complementary  use  of  the  proposed  MOOT  based  ap¬ 
proach  with  an  ordinal  linear  social  choice  function  has 
allowed  bounding  of  the  linear  social  choice  function  and 
elimination  of  infeasible  alternatives  without  detailed 
efforts  to  elicit  all  attribute  weights.  Of  course  we,  indi¬ 
rectly,  use  many  of  the  attractive  and  useful  features  of 
MAUT  in  this  procedure.  However  we  selectively  use 
portions  of  the  attribute  or  objectives  template  and  our 
MOOT  based  approach  to  bound  and  limit  criterion  or 
attribute  weight  elicitation.  Here  we  are  able  to  eliminate 
x6  from  further  consideration  and,  as  a  byproduct,  de¬ 
termine  bounds  on  a  linear  social  choice  function  trading 
off  c,(jc)  and  v2(x). 

V.  An  Example  Application  of  the  MOOT 
Based  Approach 

We  now  present  a  hypothetical  example  of  an  interac¬ 
tive  decision  support  process  which  utilizes  the  MOOT 
based  choicemaking  approach.  It  is  assumed  that  the 
template  displayed  in  Fig.  9  represents  the  attribute  struc¬ 
ture  of  the  problem.  For  example,  if  the  problem  under 
consideration  is  to  purchase  a  new  automobile,  the  attri¬ 
butes  in  Fig.  9  might  have  the  following  meaning: 

A)  safety 

B)  initial  cost 

C)  fuel  economy 

D)  scheduled  maintenance  expenses 

E)  unscheduled  maintenance  expenses 

F)  resale  value 

G)  attractiveness 

H)  trunk  and  passenger  compartment  capacity 

I)  desirability 

C)-E)  operating  cost 

B)-F)  cost. 

Note  that  the  template  indicates  that  “cost"  is  composed 
of  "initial  cost."  "operating  cost."  and  "resale  value.” 

Assume  that  six  (6)  hypothetical  alternatives  are  under 
consideration,  .v,  through  x6.  Table  l  presents  alternative 
scores  for  each  alternative  and  for  each  lowest  level  attri¬ 
bute.  These  scores  would  be  assessed  from  experts 
familiar  with  the  particular  attribute  and  alternative.  They 
correspond  to  the  tv  =  r<  v,  I  function  form  concepts  used 
in  our  previous  examples. 

The  objectives  measure  value  for  alternative  x,  is  at 
least  as  great  as  the  objectives  measure  value  for  x,  for 
every  attribute,  and  therefore  x,  dominates  xv  Similarly. 
x2  dominates  x„.  Fig.  10  presents  the  associated  digraph. 
If  the  intent  is  to  select  a  single  alternative  eventually, 
then  both  x,  and  x6  could  be  deleted  from  further  constd- 


Fig.  9.  Attribute  structure. 


TABLE  I 

Alternative  Scores  for  Lower  Level  Attributes  or 
Criteria 


Fig.  10.  Domination  digraph  for  Table  I. 

eration  at  this  point.7  If  the  ultimate  intent  is  to  select 
more  than  just  the  best  alternative,  then  all  alternatives 
require  further  consideration.  We  also  observe  that  if  the 
two  most  preferred  alternatives  are  to  be  selected  and 
x,(.x2)  is  considered  the  most  preferred  alternative,  then 
x6(.x5)  can  be  deleted  from  further  consideration. 

Fig.  10  may  contain  a  sufficient  amount  of  information 
for  choicemaking;  however,  if  this  is  not  the  case,  which  is 
very  likely  since  there  are  eight  lowest  level  attributes, 
some  trade-off  assessment  becomes  necessary.  In  order  to 
strengthen  the  partial  order  on  the  set  of  alternatives,  we 
move  up  the  objectives  template  by  performing  our  first 
trade-off.  The  attributes  which  we  assume  are  first  traded 

’Unless  there  exists  the  possibility  that  x,  may  be  "unavailable,"  in 
which  case  x<  should  be  retained,  or  the  possibility  that  x2  may  be 
"unavailable"  in  which  case  xs  should  be  retained.  Henceforth  we  will 
routinely  assume  potential  availability  of  all  alternatives. 
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TABLE  II 

Trade-Off  Weights  for  Attributes  C,  D,  and  E 


ATTRIBUTES 

C 

D 

E 

BEST  ALTERNATIVES 

x4 

X4 

x2 

WORST  ALTERNATIVES 

X5 

x6 

x4 

WEIGHTS 

.20 

.35 

.45 

TABLE  III 

Alternative  Scores  for  all  Objective  Measure 
Values:  First  Trade-Off  Case 


ALTERNATIVE  SCORES  FOR 

ATTRIBUTES 

A 

B 

C-E 

F 

G 

H 

xi 

70 

100 

63 

10 

100 

60 

X2 

100 

40 

69.5 

100 

10 

100 

a: 

> 

P-4 

X3 

60 

35 

30.75 

10 

40 

50 

< 

as 

ee 

X4 

50 

0 

55 

90 

10 

100 

F- 

•J 

< 

x5 

65 

40 

47.75 

0 

30 

55 

X6 

0 

35 

52.  5 

40 

0 

0 

TABLE  IV 

Trade-Off  Weiohts  for  Attributes  B,  C-E,  and  F 


AT" 

B 

RIBUTFS 

C-E 

F 

BEST  ALTERNATIVES 

X1 

x2 

x2 

WORST  ALTERNATIVES 

X4 

x3 

x5 

WEIGHTS 

40 

.10 

.50 

TABLE  V 

Alternative  Scores  for  Objective  Measure  Values: 
Second  Trade-Off  Case 


ALTERNATIVE  SCORES 

A  B-P  G  H 

in 

u 

> 

M 

f- 

< 

cc 

u 

f- 

5 

< 

xi 

70 

51.3 

100 

60 

X2 

100 

72.95 

10 

100 

x3 

60 

22.075 

40 

50 

X4 

50 

50.  5 

10 

100 

X  5 

65 

20.775 

30 

55 

_ 

0 

39.25 

0 

0 

Fig.  1 1.  Domination  digraph  for  Table  III. 


off  arc  C,  D,  and  E.  We  note  that  with  respect  to  each  of 
these  three  attributes,  the  best  and  the  worst  alternatives 
are  given  in  Table  II.  Assume  that  the  decisionmaker 
provides  the  following  information:  the  linear  weights  for 
comparing  the  difference  between  the  best  alternative  and 
the  worst  alternative  are  0.20,  0.35,  and  0.45  for  the  three 
attributes  C,  D,  and  E,  respectively.  Table  III  gives  the 
resulting  objectives  measure  values.  We  now  note  that  x, 
dominates  x3  and  x5,  and  x2  dominates  x4  and  x6.  Thus 
we  have  the  digraph  of  Fig.  11.  Note  that  if  the  intent 
were  to  determine  a  single  best  alternative,  it  would  be 
sufficient  at  this  point  to  eliminate  alternatives  x3,  x4,  x5, 
and  x6  from  further  consideration.  A  comparison  of  Figs. 
10  and  1 1  indicates  the  impact  of  strengthening  the  partial 
order  on  the  set  of  alternatives  by  trading  off  the  three 
attributes  C,  D,  and  E,  If  selecting  more  than  the  best 
alternative  were  the  objectives  of  the  choicemaking  effort, 
once  again  all  alternatives  would  have  to  be  considered 
further.  We  observe  also  that  if  the  two  most  preferred 
alternatives  were  being  sought  and  x,(x2)  were  chosen  as 
most  preferred,  then  x4  and  x4  (x3  and  x4)  could  be 
eliminated  from  further  consideration. 


Fig.  12.  Domination  digraph  for  Table  V. 


Fig.  II  may  convey  enough  information  to  the  de¬ 
cisionmaker  for  alternative  selection.  If  not,  as  may  well 
be  the  case  since  there  are  now  six  lowest  level  objectives, 
further  trade-off  assessment  is  required.  In  order  to  fur¬ 
ther  strengthen  the  partial  order  on  the  set  of  alternatives, 
we  assume  that  the  decisionmaker  has  decided  to  move  up 
the  template  by  trading  off  the  attributes  B .  C-E ,  and  F. 
The  best  and  worst  alternatives  for  each  of  these  attri¬ 
butes  are  given  in  Table  IV. 

Assume  that  the  decisionmaker  provides  the  following 
trade-off  information:  linear  weights  for  comparing  the 
difference  between  the  best  alternative  and  the  worst 
alternative  are  0.40,  0.10,  and  0.50  for  the  attributes  B, 
C-E,  and  F,  respectively.  Table  V  provides  the  resulting 
objectives  measure  values.  We  note  that  x,  continues  to 
dominate  x3  and  x,  but  now  also  dominates  x6.  Once 
again,  x2  dominates  x4  and  x6.  Also,  x4  dominates  x6.  The 
digraph  of  these  new  relationships  is  presented  in  Fig.  12. 
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TABLE  VI 

Trade-Off  Weights  for  Attributes  G  and  H 


ATTP.IBUTFS 

G 

H 

BEST  ALTERNATIVES 

xi 

x2'x4 

WORST  ALTERNATIVES 

x6 

X6 

WEIGHTS 

IQ 

.90 

TABLE  VIII 

Trade-Off  Weights  for  Attributes  A.  G-F,  and  G-H 


1  - -  -  1  L  — V  _  1  — - - .  1 

ALTERNATIVES 

A 

B-F 

G-H 

BEST  ALTERNATIVES 

*2 

x 

x2 

X2/X4 

WORST  ALTERNATIVES 

X6 

*5 

X6 

WEIGHTS 

.  40 

.50 

.  10 

TABLE  VII 

Alternative  Scores  for  Objective  Measure  Values; 
Third  Trade-Off  Case 


ALTERNATIVE  SCORES 

A 

B-F 

G-H 

X1 

70 

51.3 

64 

X2 

100 

72.95 

91 

Vi 

u 

> 

x3 

60 

22.075 

49 

< 

z 

cc 

X4 

50 

50.5 

91 

u 

< 

X5 

65 

20.775 

52.  5 

xf 

0 

39.25 

0 

TABLE  IX 

Alternative  Scores  for  Objective  Measures  Values; 
Final  Case 


Fig.  13.  Domination  digraph  for  Table  VI. 


From  this  digraph  we  observe  that  x6  need  not  be  consid¬ 
ered  further  if  the  objective  is  to  seek  the  best  and  second 
best  alternatives.  We  also  note  that  if  the  decisionmaker 
could  select  x2  as  the  most  preferred  alternative  without 
further  assessment,  then  x}  and  x,  each  would  join  x6  as 
being  at  best  the  third  most  preferred  alternative.  If  x,  is 
the  most  preferred,  then  x2,  x3,  and  x,  would  compete  for 
second  best,  x4  could  be  no  better  than  third  best,  and  x6 
could  not  be  better  than  the  fourth  most  preferred. 

If  the  second  trade-off  has  not  provided  the  decision¬ 
maker  with  enough  information  to  make  the  desired  selec¬ 
tions.  another  trade-off  assessment  is  required.  We  there¬ 
fore  move  up  the  template  by  trading  off  at  least  some  of 
the  second  level  attributes.  Assume  the  decisionmaker 
elects  to  trade  off  the  attributes  G  and  H.  Table  VI  lists 
the  best  and  worst  alternatives  and  their  associated  incre¬ 
mental  weights  for  each  of  these  two  attributes.  Table  VII 
lists  the  resulting  objectives  measure  values,  and  Fig.  13 
presents  the  associated  digraph.  It  is  now  clear  that  x,  is 
the  most  preferred  alternative  and  x,  and  x4  would  com- 


© 

Fig.  14.  Domination  digraph  for  Tabic  IX. 
TABLE  X 

Final  Weights  for  Lowest  Level  attributes 


A 

0.4000 

B 

0.2000 

C 

0.0100 

D 

0.0175 

E 

0.0225 

F 

0.2500 

G 

0.0100 

II 

0. 0900 
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TABLE  XI 

Alternative  Scores  for  Objective  Measure  Values: 
Third  Trade-Off  Case  with  Varied  Wejohts 


ALTERNATIVE 

ALTERNATIVE  SCORES 

A  B-F  GH 

X1 

70 

51.3 

74 

*2 

100 

72.95 

60.5 

*3 

60 

22.075 

46.5 

X4 

50 

50.  5 

60.5 

X5 

65 

20.775 

46.25 

X6 

0 

39.25 

0 

TABLE  XII 

Possibility  Subsets  for  N  Best  Alternatives,  V-  1,2 


TABLE 

FIGURE 

ORDERED  SUBSET  CANDIDATES  FOR  N 

BEST  ALTERNATIVES 

SUBSET  GUARANTEED  TO  CONTAIN 

N  MOST  PREFERRED  ALTERNATIVES 

1 

9 

X1  “  ( x2 )  #  (Xj),  (x4)l 

X1  -  (x1,x2,x3,x4) 

X2  -  ((Xj.Xjl,  (Xj.Xj),  (x^.Xjl,  (Xj.Xj), 

X2  *  (x^,x2»x3,Xj,x j,Xg } 

(XjpXj),  (XjpX^lp  (XjpXj),  (XjpXg), 

(Xj.Xjl,  {x3,x2),  (x3,x4>,  fx4,Xj), 

(x4,Xj),  (x4,x3ll 

3 

10 

Xj  •  ( (Xj  )  ,  (Xj  1  ) 

XL  -  (Xj.Xj ) 

X2  -  {(Xj.Xj),  (Xj.Xj),  (Xj.Xj),  (x2,Xjl, 

Xj  m  ^X^iXjfXjiX^iXjfXg) 

(Xj,x4 1 ,  lx2 ,x6  H 

5 

11 

*1  "  1  (Xj  ) *  (x2n 

X ^  *  {x^ ,x2 } 

*2  *  ( (x1#x2 },  (Xj,Xj),  {Xj^Xj),  {x2,x^}. 

X2  ■  (Xj»X2»X3 ,X^,Xg} 

{x2,x4 } > 

6 

12 

X!  -  "V 

Xx  *  ( x 2 ) 

*2  -  { (Xj.Xj  \ ,  (x2»x4  f 1 

Xj  •  (Xj ,Xj ,x4 ) 

9 

13 

Xj  «  l lx2) )  , 

Xj  »  { X 2 } 

*2  -  Ixj.x^'- 

Xj  ■  {  Xj  ,X2  ) 

pete  for  second  most  preferred.  If  jc4  were  chosen  to  be 
second  best,  then  jc,  would  be  the  third  most  preferred 
alternative,  with  .x3.  xy  and  xt  competing  for  fourth  best. 
If,  however,  .t,  were  chosen  as  second  best,  .x3,  x4,  and  .r5 
would  compete  for  third  best,  and  xb  would  be  at  best  the 
fourth  most  preferred.  We  now  have  moved  up  the  attri¬ 
bute  tree  or  template  such  that  there  are  only  three  lowest 
level  attributes.  They  correspond  to  safety,  costs,  and 
attractiveness  in  terms  of  beauty  and  spaciousness.  At 
higher  levels  in  the  attribute  template,  trade-offs  become 
more  difficult  to  make  as  the  “noncommensurateness"  of 
the  attributes  increases  as  we  move  up  the  tree.  Choice¬ 
making  at  this  point,  or  prior  to  this  point,  seems  a  strong 
possibility.  Interactive  computer  graphics  to  present  the 
results  of  figures  and  tables  such  as  these  to  the  de¬ 


cisionmaker  will  be  most  desirable  as  aids  in  choicemak¬ 
ing.  It  will  be  very  difficult  to  do  this  for  many  objectives 
which  is  another  reason  that  appears  to  support  the  poten¬ 
tial  attractiveness  of  our  proposed  approach. 

In  order  to  order  the  alternatives  totally,  if  such  a  total 
ordering  were  necessary,  trading  off  all  three  of  the  re¬ 
maining  attributes  would  be  required.  All  hypothetically 
assessed  trade-off  information  and  associated  results  are 
provided  in  Tables  VIII  and  IX  and  in  Fig.  14;  Table  X 
lists  the  final  weights  for  the  initial  attributes. 

We  expect  that  the  decisionmaker  frequently  will  not 
require  full  trade-off  assessment  for  choicemaking  and 
hence  will  elect  to  reach  a  decision  using  the  decisionmak¬ 
ing  support  process  before  the  final  assessment.  Regard¬ 
less  of  the  stage  at  which  final  evaluation  is  made,  how- 
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ever,  the  decisionmaker  is  likely  to  want  to  know  the 
impact  of  trade-off  weight  variation  and  initial  objective 
measure  value  variation  on  the  digraph  structure.  For 
example,  let  the  weight  for  attribute  G  in  Table  VI  be 
changed  from  0.10  to  0.35,  thus  changing  the  weight  for 
attribute  H  to  0.65.  The  new  table  of  objectives  measure 
values  are  presented  in  Table  XI  and  its  associated  di¬ 
graph  in  Fig.  15.  This  sort  of  sensitivity  analysis  should 
always  precede  final  alternative  selection  especially  where 
there  are  any  questions  concerning  subjectivities  of  either 
the  alternative  scores, or  criterion  (attribute)  weights. 

Table  XII  presents  the  °X„  and  Xn,  n—  1,2,  for  this 
example  for  each  level  of  trade-off  considered.  We  note 
that  the  number  of  elements  in  both  and  Xn  decrease 
as  the  number  of  trade-offs  increase,  which  is  in  agree¬ 
ment  with  the  corollary  presented  in  Section  IV. 


VI.  Conclusion 

We  have  presented  an  approach  to  choicemaking  which 
may  substantially  reduce  the  amount  of  trade-off  informa¬ 
tion  required  from  the  decisionmaker  relative  to  the 
MAUT  approach.  The  approach  presented  may  be  used 
to  complement  the  MAUT  approach  and  as  an  alternative 
to  it.  The  most  general  assumption  considered  relative  to 
the  amount  of  preference  information  that  should  be 
elicited  from  the  decisionmaker  was  the  partial  preference 
feedback  assumption.  Two  special  cases  of  the  partial 
preference  feedback  assumption  were  considered.  The 
complete  preference  feedback  case  was  considered  in  de¬ 
tail.  and  three  procedures  were  presented  to  enhance  the 
likelihood  that  this  assumption  would  hold.  The  no  prefer¬ 
ence  feedback  case  was  examined  by  means  of  an  exam¬ 
ple.  We  remark  that  the  partial  preference  feedback  case 
is,  to  borrow  a  phrase  from  the  optimum  systems  control 
literature,  a  closed-loop  procedure  involving  decision¬ 


maker  preferences  which  augment  those  preferences 
elicited  in  construction  of  the  vector  of  objectives  func¬ 
tions.  By  analogy,  the  no  preference  feedback  case  is  an 
open-loop  procedure. 

Future  research  and  application  of  the  MOOT  based 
approach  to  choicemaking  will  include  risk  and  uncer¬ 
tainty  considerations  and  will  indicate  behaviorally  rele¬ 
vant  procedures  for  implementation  of  the  approach  to 
form  a  planning  and  decision  support  process  for  aided 
choicemaking.  Contrasts,  comparisons,  and  complemen¬ 
tarity  with  the  well-known  MAUT  approach  will,  of 
course,  be  of  interest. 
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This  paper  presents  a  survey  of  human 
information  processing  and  associated  inference 
analysis  in  decentral ized  organizations  as  a 
large  scale  systems  problem.  One  purpose  of  aids 
for  inference  analysis  is  to  assist  humans  in 
using  techniques  which  allow  them  to  make 
better  use  of  information.  The  use  of  hierar¬ 
chical  systems  concepts  with  structured  logical 
reasoning  protocols  is  discussed  and  illu¬ 
strated  in  this  overview  paper. 

INTRODUCTION 

In  processing  information,  it  is  generally 
assumed  that  observed  data  is  directly  related 
to  a  hypothesis  under  consideration.  Further, 
it  is  assumed  that  the  impact  of  data  on  the 
probability  of  a  hypothesis  being  correct 
can  be  computed  in  a  straightforward  fashion 
by  use  of  8ayes*  rule.  This  process  is  known 
as  inference.  It  may  operate  in  an  inductive 
or  deductive  manner.  Typically  inferences 
are  structured  in  a  deductive  fashion  and 
data  are  processed  in  an  inductive  manner. 

There  are  at  least  two  complexities  which  may, 
in  practice,  make  this  difficult  to  accomplish: 

1.  The  complexity  and  knowledge  require¬ 
ments  associated  with  many  information 
processing  tasks  may  be  so  great  that 
no  single  individual  may  be  able  to 
supply  the  required  information. 

2.  Multi-stage  information  processing 
tasks,  that  is  tasks  where  data  are 
not  directly  and  immediately  related 

to  the  hypothesis  under  test,  are  complex. 
Rather  involved  computations  may  be 
requ i red . 

Hierarchical ly  decomposing  multiple  stage 
inferential  information  processing  tasks  into 
a  number  of  single  stage  inference  tasks,  and 
then  aggregating  the  results  of  these  single 
stage  inferences,  may  resolve  each  of  these  two 
potential  difficulties.  It  may  allow  experts, 
with  an  appropriate  knowledge  base,  to  partici¬ 
pate  in  portions  of  the  inference  task  in  a 
logically  consistent  manner  that  is  also  appro¬ 
priate  in  terms  of  the  experts  knowledge  base. 


Computations  in  a  hierarchical  framework  will 
generally  be  easier  than  computations  in  an 
undecomposed  format.  There  is  experimental 
evidence  to  indicate  [1,  2]  that  hierarchical 
decomposition  of  human  inference  tasks  reduces 
the  tendency  of  humans  to  selectively  process 
more  favored  data  while  virtually  ignoring  other 
data.  The  result  of  this  is  cognitive  infor¬ 
mation  processing  bias  [3,  4]  that  may  result  in 
a  very  flawed  judgment  and  choice. 

This  paper  discusses,  at  a  conceptual  level, 
relations  between  frameworks  for  information 
processing  and  hierarchical  information  proces¬ 
sing.  We  indicate,  in  a  preliminary  way,  how 
Structured  frameworks  of  decision  situations 
influence  information  needs  and  information 
processing  within  a  hierarchical  inference  format. 

2.  Hierarchical  Inference  Analysis 

In  a  very  large  number  of  contemporary  areas 
of  interest,  there  are  issues  involving  the 
possible  occurrence  of  uncertain-to-occur  events. 
Often  we  can  obtain  more  veridical  results  in 
determining  probabilities  and  likelihoods  for 
event  outcomes  if  they  are  conditioned  upon  the 
occurrence  of  other  events  and/or  decisions.  This 
approach  forms  the  basis  for  cross  impact  analysis, 
hierarchical  inference  analysis,  and  other  related 
approaches  in  which  probability  structures  or 
probability  diagrams  have  proven  to  be  of  con¬ 
siderable  value  [5]. 

In  these  approaches,  it  is  assumed  that  ob¬ 
served  information  can  be  directly  related  to 
postulated  hypotheses  and  that  the  impact  of  ob¬ 
served  information  on  the  probability  of  a  given 
hypothesis  being  true,  or  occurring,  evolves 
sequentially  according  to  Bayes  rule.  The 
complexity  of  many  contemporary  large  scale 
issues  is  such  that  the  amount  and  type  of  cog¬ 
nitive  skills  and  technical  knowledge,  required 
to  express  all  appropriate  probabilities  or  like¬ 
lihood  ratios  which  infer  or  link  all  informa¬ 
tion  elements  to  postulated  hypotheses,  is  be¬ 
yond  the  unaided  capability  of  any  single  indi¬ 
vidual,  and  often  even  the  aided  capability. 

One  possible  approach  to  ameliorate  this  situa¬ 
tion  is  to  disaggregate  the  complex  issue  into 
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i  hierarchical  structure  such  as  the  gerc'C 
structured  framework  suggested  by  Figure  1. 

In  the  hierarchical  approach  to  information 
structuring  and  associated  inference,  a  number 
of  intermediate  elements  are  identified.  These 
elements  typically  represent  activity  states  or 
activity  indicators  which  are  relevant  to  the 
nostulated  hypotheses.  These  activity  states 
or  activity  indicators  are  presumed  to  be  mea¬ 
ningful  representations  of  a  portion  of  the 
issue.  They  correspond  to  the  six  elements 
in  Figure  1.  Probabilities  which  relate  ob¬ 
served  information  to  these  intermediate 
elements  are  assessed  or  elicited,  as  well 
as  the  probabilities  which  relate  these  inter¬ 
mediate  elements  to  the  postulated  hypotheses. 

Also  included  are  propositions  and  implications 
from  logical  reasoning  such  that  it  becomes 
possible  to  display  credibility  and  plau¬ 
sibility  indices  that  encourage  detection  of 
individual  inconsistencies  as  well  as  group 
differences  with  respect  to  recognition  and 
enhanced  communication  of  differences  in  mes¬ 
sage  interpretation  and  the  rationale  for  this. 

The  rationale  behind  this  approach  is  be- 
haviorally  and  organizationally  compelling. 

Parties  at  interest  to  a  given  issue  may  be 
expert  in  diverse  portions  of  the  complete 
issue  and  a  single  individual,  or  group,  will 
probably  not  have  sufficient  experience  and 
knowledge  to  relate  lowest  level  information 
to  highest  level  hypotheses.  If  a  complex 
issue  is  hierarchically  decomposed,  it  may  be 
possible  to  utilize  the  abilities  and  knowledge 
of  various  experts  in  an  efficient  and  logically 
consistent  fashion.  Presumably,  organizations 
are  structured  in  a  hierarchical  manner  to  take 
advantage  of  opportunities  such  as  these. 

There  is  no  unique  structure  for  a  hierar¬ 
chical  model  of  a  given  issue.  These  models  are 
necessarily  subj'?ct'ive  contingency  structures 
in  that  they  can  only  represent  a  conceptual 
model  of  a  particular  issue,  and  the  way  in  which 
a  particular  issue  is  disaggregated.  The  in¬ 
fluence  of  various  cognitive  styles  of  the  indi¬ 
vidual  or  group  constructing  the  model  and  the 
influence  of  various  constraints,  such  as  envi¬ 
ronmental  constraints,  are  generally  the  stron¬ 
gest  determinants  affecting  the, choice  of  a  par¬ 
ticular  hierarchical  model.  Still  the  generic 
structure  of  Figure  1  appears  fully  appropriate 
to  capture  the  subleties  required  by  many  effec¬ 
tive  information  processing  tasks.  It  would 
appear  appropriate  as  well  for  providing  a 
logical  framework  for  discussing  differing  plau¬ 
sible  interpretations  of  assumptions  and  intents. 

A  generic  prototypical  hierarchical  inferen¬ 
ce  structure  will  consist  of  five  different  types 
of  elements: 

1.  H.,,  i  «  1,2 . a  set  of  mutually 

exclusive  hypotheses  which  describe  the 
issue  under  consideration,  often  in 
terms  of  claims. 


2.  A.,  i  =  1,2,...,  a  set  of  identified 
inferred  activities,  or  possible 
surrogate  activities,  which  represent 
observed  cues  relative  to  the  issue 
or  diagnostic  of  the  hypotheses  under 
consideration.  Each  activity  category, - 
A.,  may  be  further  disaggregated  into 
a'set  of  mutually  exclusive  exhaustive  . 
subactivity  states  Al ,  j  ■  1,2,...  . 

3.  I . ,  i  -  1,2,...,  activity  indicators 
which  impact  upon  the  hypotheses  throgh 
various  activities.  Any  activity  in¬ 
dicator  may  consist  of  a  number  of 
mutually  exclusive  exhaustive  subac¬ 
tivity  indicator  state  variables, 

IJ. ,  j  *  1,2,...,  which  are  presumed 
to1  be  diagnostic  of  the  related  im¬ 
pact  activity  state  variable,  A^. 

4.  E.,  i  =  1,2,...  events,  or  outcome 
slates  that  influence  the  indicators. 
The  events  are  not  guaranteed  to  have 
occurred;  rather  there  are  infor¬ 
mation  reports  on  occurrence,  or  non- 
occjr'eice  )f  events. 

5.  V.,  i  =  1,2 . data  or  information 

variables  which  may  impact  directly 
on  hypotheses,  activities,  activity 
indicators,  or  events. 

Data  or  information  variables  or  elements  may 
connect  with,  or  impact,  directly  to  hypotheses,  an 
activity,  or  activity  indicator  variables  or 
elements.  Activity  indicator  states  must  connect 
with  or  directly  impact  activity  states.  Activi¬ 
ty  states  may  connect  to  activity  indicator 
states  or  hypotheses.  By  definition,  the  hypo¬ 
theses  are  at  the  top  level  of  the  inference 
hierarchy  and  correspond  to  the  “claim"  in  Figure 
1.  Since  an  activity  state  may  be  just  a  surro¬ 
gate  for  a  hierarchy,  we  can,  in  effect,  allow 
hypotheses  to  appear  at  other  than  the  top  level 
of  the  structure.  Formally,  however,  hypotheses 
will  be  at  the  top  of  the  structure.  Figure  2 
represents  a  prototypical  hierarchical  inference 
structure.  Hypotheses  are  at  the  top  level  of 
these  structures.  The  second  level  contains 
various  activities.  A- ,  which  directly  influence 
the  hypotheses.  The  next  level  contains  indi¬ 
cators  which  impact  directly  on  activities  that 
are  at  the  second  level.  The  fourth  level  con¬ 
tains  the  events,  which  influence  various  activi¬ 
ty  indicators.  At  the  fifth  and  final  level  of 
these  structures,  we  have  various  information 
variables  or  observables.  Figure  2  represents 
the  inference  structure  thus  described.  The 
procedure  to  develop  an  hierarchical  inference 
tree  involves  determination  of  an  important 
influential  or  causal  structure.  There  are  a 
variety  of  structuring  procedures  that  can  be 
used  for  this  purpose  [6,  7],  Jn  general,  the 
inference  tree  can  have  many  more  than  5  levels. 

Computations  based  upon  hierarchical 
inference  are  conceptualized  in  a  relatively 


simple  way.  The  posterior  probability  that  a 
particular  hypothesis  is  true  given  an  observed 
datum  is,  where  P  (/)  denotes  conditional 
probability, 

P  (H/V)  *  P  (H}  P  (V/H)  (1) 

FTvT 

To  make  this  calculation  we  need  to  know  the 
prior  probability  that  the  hypothesis  will  be 
correct  and  the  prior  probability  that  the  data 
will  be  observed.  Further  we  need  to  know  the 
conditional  probability  that  the  data  will  be 
observed  conditioned  upon  the  hypothesis  being 
valid. 

When  data  influence  various  events,  E.,  then 
we  can  calculate  the  conditional  probability 
of  a  hypothesis  being  correct  from 

P(H) 

*  (H/V)  =  ^XvT  5  P  <v/Ej»H)p(Ei/H)  (2) 

Now  we  need  to  know  the  probabilities  that  the 
datum  will  occur  conditioned  upon  the  events 
and  the  hypothesis.  This  •  ort  of  expansion 
can  be  continued  such  that  we  can  evaluate 
the  probability  of  a  hypothesis  conditioned 
upon  many  events,  activities,  activity  indi¬ 
cators,  and  data.  Generally,  the  calculations 
are  extraordinarily  complex  unless  independence, 
P( V/E  .  ,H)  =  P(V/E -) ,  exists. 

J  J 

We  need  to  obtain  P(H/V)  for  use  in  a 
decision  analysis  effort.  However,  estimates 
of  the  quantities  on  the  right  hand  side  of 
Exs.  (1)  and  (2)  are  normally  much  more  easily 
obtained.  These  are  readily  available  from 
a  hierarchical  inference  structure. 

We  may  assess  probabilities  for  a  hierar¬ 
chical  inference  structure  in  either  deductive 
or  indictive  form.  In  a  deductive  structure, 
the  hypotheses  at  the  top  of  the  structure  are 
"source"  elements  for  a  single  source  digraph 
tree  which  begins  at  the  various  hypotheses. 

In  an  inductive  structure  the  hypotheses  at  the 
top  of  the  structure  are  "sink"  elements  for 
a  single  sink  digraph  tree  which  terminates  at 
the  various  hypotheses  at  the  top  of  the  tree. 
The  hierarchical  inference  structure  of  Figure 
2  may  be  replicated  several  times  over  to  form 
the  structure  of  Figure  1. 

3.  Hierarchical  Inference  as  a  Large  Scale 

System  Issue 


It  is  possible  to  examine  and  evaluate  the 
potential  increase  in  potential  predictive 
accuracy  made  possible  by  replacing  simple 
hierarchical  inference  models  in  which  informa¬ 
tion  samples  are  assumed  to  be  received  inde¬ 
pendently,  by  one  in  which  information  samples 
are  assumed  dependent.  There  are  two  basic 


types  of  information  sample  depende'Cies;  enhan¬ 
cing  and  inhibiting.  In  the  enhancing  depen¬ 
dency  case,  the  probability  in  favor  of  a 
hypothesis  being  true  if  two  correlated  infor¬ 
mation  samples  are  received  is  greater  than  what 
it  would  be  if  the  two  samples  were  independent. 
The  opposite  is  true  in  the  case  of  inhibiting 
dependency  information.  If  either  enhancing  or 
inhibiting  information  is  present,  i.e.,  if 
dependent  information  samples  are  observed,  then 
an  extra  activity  state  variable  can  be  intro¬ 
duced  as  a  surrogate  to  formally  make  the  infor¬ 
mation  samples  independent.  The  use  of  this 
intervening  activity  state  variable  will  allow 
observed  information  to  be  diagnostic  of  this 
surrogate  state  which  is,  in  turn,  diagnostic  [8] 
of  the  fundamental  hypotheses  under  considera¬ 
tion,  Figure  3  displays  some  possible  numerical 
results  to  support  this. 

There  is  a  considerable  elicitation  and 
assessment  effort  saving  if  information  samples 
are  independent  since  it  is  not  necessary  to 
elicit  or  estimate  conditionally  dependent 
probabilities  or  likelihoods.  There  are  at 
least  two  major  implications  of  this  for  infe¬ 
rence  analysis: 

a)  Careful  structuring  of  decision  situation 
and  inference  structures  to  result  in 

a  minimum  of  information  dependencies 
may  be  very  rewarding.  A  study  of  the 
tradeoffs  between  structural  and  infor¬ 
mation  dependency  complexities  is,  there¬ 
fore,  an  important  research  topic. 

b)  Aggregating  strongly  correlated  infor¬ 
mation  samples  prior  to  elicitation  or 
estimation  of  probabilities  or  likeli¬ 
hoods  may  result  in  reduced  dependencies 
and  therefore  reduced  overall  effort. 
Again,  there  are  some  interesting  trade¬ 
offs  involved  in  this  although  they  will 
be  more  subjective  and  difficult  to 
quantify  than  in  case  a. 

It  is  possible,  also,  to  examine  and  investi¬ 
gate  the  effects  of  nonstationary  environments 
upon  hierarchical  inference.  Inmost  hierarchi¬ 
cal  inference  models,  it  is  assumed  that  the 
marginal  or  prior  probability  of  hypothesis  H. 
being  true,  P ( H - ) ,  is  independent  of  information 
being  received,  or  time.  This  is,  of  course,  not 
necessarily  true.  A  Kalman-filter-like  struc¬ 
ture  [9,10]  may  be  used  to  accommodate  the 
estimator  part  of  a  combined  estimation-detection 
type  scheme  for  processing  inferential  informa¬ 
tion.  Although  much  has  been  written  about  com¬ 
bined  estimation  and  detection  for  optimal  con¬ 
trol  type  problems  there  appears  to  have  been 
few  if  any  efforts  to  relate  this  to  typical 
decision  analysis  and  inference  analysis  type 
problems.  A  difficulty  in  accomplishing  this 
is  that  structural  changes  are  typically  incor¬ 
porated  in  a  deductive  fashion  whereas  para¬ 
metric  information  updates  are  processed  in  an 
inductive  fashion  in  the  Kalman  filte'. 


895 


Of  course,  a  simple  probability  function 
for  hypothesis  change  can  be  used  to  adjust 
the  prior  probabilities  after  each  information 
update.  This  change  probability  would  be  a 
function  of  information  received  and  time. 

Clearly  the  approach  is  suboptimal  but  it  may 
be  effective  in  that  the  approach  is  simple, 
relatively  easy  to  understand,  and  probably 
does  not  introduce  major  errors.  Thus,  it 
should  result  in  enhanced  analysis  ability 
with  respect  to  modeling  and  comprehension  of 
decision  situations  in  nonstationary  environ¬ 
ments.  A  simple  and  appropriate,  but  sub- 
optimal,  approach  is  almost  always  better 
than  a  more  correct  complex,  difficult  to 
comprehend,  and  improperly  used  approach,  espe¬ 
cially  in  situations  in  which  process  concerns, 
which  involve  human  and  behavioral  factors , 
are  important. 

Also,  it  is  possible  to  examine  and  eva¬ 
luate  the  effects  of  various  stopping  rules  and 
newly  generated  or  identified  hypotheses.  In 
many  information  purchasing  studies,  a  decision¬ 
maker  may  make  a  decision  after  receipt  of  any 
given  sample  of  information.  “Optimal  stopping" 
-'s  a  term  used  -o  refer  to  sufficiently  well 
structured  inference  situations  where  the  costs, 
diagnosticity,  utilities  and  payoffs,  are  well 
known.  One  can  precompute  and  select  a  best 
time  to  make  a  decision.  Several  realities  com¬ 
plicate  the  picture,  however.  Information  ga¬ 
thering  and  processing  behavior  may  be  quite 
different  after  a  decision  has  been  made  than 
before  the  decision  was  made.  More  information 
of  a  given  quality  may  be  required  in  order  to 
influence  a  decisionmaker  to  change  a  decision 
once  it  has  been  made,  i.e.,  after  commitment 
to  a  decision,  than  that  initially  required  to 
make  the  decision.  Prior  to  decision  commit¬ 
ment,  information  is  processed  to  increase  the 
likelihood  of  making  a  good  decision.  Post- 
decisional  commitment  information  is  often  used, 
or  misused,  to  justify  the  already  committed 
to  course  of  action.  Clearly,  inferences  are 
made  postdecision  as  well  as  predicision,  and 
a  study  of  postdecision  inference  analysis 
should  lead  to  rather  interesting  and  useful 
results. 

Hypothesis  evaluation  and  inferences  are 
made  possible  because  of  a  very  precise  and 
specific  problem  formulation  and  structuring  in 
which  uncertainties  are  represented  by  a  (finite) 
set  of  exhaustive  and  mutually  exclusive  hypo¬ 
theses,  This  exclusivity  requirement  pre¬ 
cludes  identifying  and  expanding  the  hypothesis 
space  as  the  inference  analysis  effort  progres¬ 
ses  in  time.  In  realistic  situations,  the 
receipt  of  additional  information  will  often 
result  in  suggestions  for  and  identification  of 
new  hypotheses  as  well  as  in  updates  to  hypo¬ 
thesis  probabilities. 


There  are  a  number  of  interesting  implica¬ 
tions  to  this.  One  and  only  one  hypothesis 
from  a  mutually  exclusive  well-posed  set  can  be 
true.  The  conventional  structure  of  an  inferen¬ 
ce  analysis  problem  does  not  provide  for  the 
possibility  that  more  than  one  of  the  hypothesis 
is  true,  or  that  none  of  the  initially  posted 
hypotheses  may  be  true,  or  the  one  that  is  true 
may  not  be  identified  until  later.  Structurally, 
we  may  add  additional  hypotheses:  or  for  that 
matter  activities,  activity  indicators,  events 
and/or  information  sources.  The  structural 
changes  due  to  bordering  an  additional  inference 
element  onto  an  existing  inference  tree  result 
in  some  interesting  and  apparently  unexplored 
problems  in  structural  sensitivity  analysis.  To 
investigate  the  effect  of  inference  structure 
changes  due  to  sequential  hypothesis  generation 
may  lead  to  interesting  conclusions  concerning 
the  "value  of  structure  and  information"  that 
may  compliment  the  many  existing  studies  con¬ 
cerning  (only)  the  value  of  information.  This 
will  be  especially  the  case  when  it  becomes 
possible  to  determine  a  useful  problem  formu¬ 
lation  to  allow  joint  consideration  of  optimum 
stopping,  postdecirion  inferences,  and  pro  and 
postdecision  sequential  hypothesis  generation. 

A.  Suimiary 

This  paper  has  described  contemporary  ef¬ 
forts  in  hierarchical  inference  as  a  large 
scale  systems  problem.  A  number  of  suggestions 
have  been  made  for  efforts  which  add  considerable 
realism  to,  and  which  enhance  the  utility 
of,  formal  hierarchical  inference  approaches  in 
enhancing  human  infomation  processing. 

Many  recent  studies  in  cognitive  science  in¬ 
dicate  that  people  are  flawed  information  pro-  * 
cessors  due  to  their  failure  to  [12]: 

1.  Seek  disconfirming  information 

2.  Analyze  disconfirming  information 

3.  Identify  alternative  hypotheses 

4.  Consider  whether  evidence  supporting  a 
favored  hypothesis  supports  alternative 
hypotheses  just  as  well;  or  perhaps 
even  better. 

The  goal  of  adjuvants  to  human  information  pro¬ 
cessing  is  to  eliminate  these  flaws  through 
appropriate  detection  of  biases  and  flaws, 
and  through  appropriate  debiasing  procedures. 
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Fig.  1.  A  Possible  Structure  for  Information  Processing  Based  Upon 
the  Six  Elements  of  Logical  Reasoning 
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Fiq.  2.  Prototypical  Hierarchical  Inference  Structure 


Illustration  Showing  how  Redundancy  or  Dependency  can  Result  from 
Independent  Data  and  Introduction  of  a  State  Variable.  Continued 
use  of  Bayes'  Rule  enables  determination  of  P(H,/V1,V2)  etc. 
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Abstract.  This  oaner  discuss  needs  for  and  potential  accomplishments  that 
could  result  from,  development  of  a  theory  of  human  system  identification. 


NEEDS  FOR  HUMAN  SYSTEM  IDENTIFICATION 

Much  recent  research  has  concerned  cognitive 
heuristics  and  biases  [1 J  that  degrade  infor¬ 
mation  processing  [2];  human  inference;  and 
associated  human  judgment,  choice  and  decision¬ 
making  [3,4,5].  It  is  very  important  that 
planning  and  decision  support  processes  deter 
use  of  these  biases  as  well  as  seek  to  over¬ 
come  the  many  other  fundamental  limitations 
of  systems  engineering  and  related  areas  [6]. 

To  do  this  requires  the  design  of  planning 
and  decision  support  systems  and  processes 
[5,7]  that  are  adaptive  to  user  requirements, 
problem  situations,  and  the  experiential  fami¬ 
liarity  of  the  user  with  these  elements  that, 
taken  together,  constitute  the  contingency 
task  structure.  Design  of  an  aopropriate 
planning  and  decision  support  system  requires 
an  integration  of  the  descriptive  and  the 
prescriptive.  It  requires  that  we  be  able 
to  not  only  detect,  but  that  we  also  correct 
for  shortcomings  in  human  information  pro¬ 
cessing  such  as  to  support  efficient  and 
effective  management  of  information.  It 
requires,  in  effect,  system  identif ication  of 
Tie  human-organization-computer  process  that 
involves  knowledge  organization,  information 
processing,  and  associated  judgment  and  choice. 

)  ' 

The  purpose  of  Information  Systems  for  plan¬ 
ning  and  decision  support  is  to  provide  time¬ 
ly,  relevant,  and  accurate  information  such 
as  to  enhance  human  judgment,  and  decision¬ 
making  efficiency  and  effectiveness,  concerning 
planning  and  the  associated  resource  alloca¬ 
tions.  Not  only  should  these  systems,  and 
associated  processes,  aid  and  support  the 
decisionmaker  in  makinq  efficient  and  effec¬ 
tive  decisions;  they  should  also  enhance  con¬ 
fidence  both  in  present  decisions  and  in  the 
ability  to  make  more  efficient  and  more  effec¬ 
tive  decisions  in  the  future. 

For  maximum  efficiency  and  effectiveness, 
available  resources  must  be  allocated  and  co¬ 
ordinated  both  in  space,  through  a  hierarchy 
of  decisionmakers,  and  in  time,  as  new  infor¬ 
mation  arrives  and  the  environmental  situation 


extant  changes.  Associated  information  ac¬ 
quisition,  analysis,  and  evaluation  must, 
as  a  consequence,  be  distributed  both  in 
space  and  in  time.  Information  acouisition, 
analysis  and  evaluation  must  be  accomplished 
selectively  in  space  and  time  since  different 
decisionmakers  have  different  information 
needs.  In  addition,  it  will  be  physically 
impossible  and  behaviorally  undesirable  to 
supply  all  relevant  information  to  each 
decisionmaker  in  the  hope  that  it  will  be 
effectively  cognized  and  utilized.  Further, 
differences  in  education,  motivation,  e'x- 
perienc»s  with  the  environmental  situation 
extan-  d  stress  will  influence  cognitive 
informal..  processing  style.  Consequently, 
a  central  task  in  the  design  of  systems  is 
that  of  selection  and  choice  of  appropriate 
information  system  architecture  to  enhance 
selective  information  acquisition,  analysis, 
and  interpretation  in  order  to  provide  each 
user  of  the  system  with  the  most  appropriate 
information  at  that  appropriate  time.  Thus 
questions  of  information  selection,  infor¬ 
mation  aggregation  in  space  and  in  time,  and 
the  contingency  task  structure, which  is  a 
function  of  the  environment  and  the  decision¬ 
makers,  become  of  major  importance. 

As  is  true  with  systems  engineering  efforts 
generally,  the  structural  components  of  a 
planning  and  decision  support  system  con¬ 
sist  of  adjuvants  for: 

a)  issue  formulation 

b)  issue  analysis 

c)  issue  interpretation 

The  issue  formulation  adjuvant  will  enable 
decisionmakers  to  acquire,  process,  and 
evaluate  information  in  order  to  perceive 
the  current  state  of  the  environment;  to 
compare  that  perception  with  a  desired  state; 
and  to  identify  possible  action  alternatives 
which  might  cause  the  environmental  state 
extant  to  change  such  as  to  be  more  in  con¬ 
formity  with  the  desired  environmental  state. 
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The  issue  analysis  adjuvant  will  enable  deter¬ 
mination  or  analysis  of  the  impacts  of  the  pro¬ 
posed  action  alternatives  in- terms  of  environ¬ 
mental  state  changes.  Finally,  the  inter¬ 
pretation  adjuvant  will  allow  valuation,  in 
accordance  with  a  value  system,  of  the  identi¬ 
fied  action  alternatives  in  terms  of  their  im¬ 
pacts  upon  the  environment  such  as  to  enable 
selection  of  one  or  more  of  the  proposed  action 
alternatives  for  deployment  or  implementation. 

A  variety  of  questions  and  concerns  make  design 
and  application  of  the  aforementioned  adju¬ 
vants  a  non  routine  task.  Perhaps  central 
among  these  questions  and  concerns  is  the  fact 
that  decisionmakers  may  differ  considerably 
in  their  education,  motivation,  and  prior  ex¬ 
perience  with  particular  operational  environ¬ 
ment  conditions  extant.  Whether  a  formal 
operational  style  or  concrete  operational  style 
of  cognition  is  appropriate  for  a  particular 
contingency  task,  and  whether  or  not  this  will 
be  used,  is  strongly  dependent  upon  these 
factors  and  the  type  of  stress  that  they 
produce  [8]. 

Automated  aids  must,  consequently,  be  flexible 
in  the  sense  of  being  capable  of  adaptation  to 
a  variety  of  information  processing  and  judg¬ 
mental  styles  that  are  difficult  to  specify 
a  priori.  Further,  they  must  be  parsimonious 
with  respect  to  overloading  neither  the  data 
base  management  subsystem  which  will  degrade 
efficiency,  effectiveness  and  reliability  of 
information  retrieval  from  computer  memory, 
nor  the  human  information  subsystem,  which  will 
result  in  an  increase  in  stress  and  the  like¬ 
lihood  of  use  of  cognitive  information  proces¬ 
sing  biases  and  poor  judgmental  heuristics. 

Expert  decisionmaking  is  typically  done  in  a 
concrete  operational  mode  of  cognition,  and 
involves  use  of  one  or  more  of  a  variety  of 
typically  wholistic  judgmental  efforts.  These 
decision  styles  are  doubtlessly  appropriate  for, 
and  potentially  capable  of  excellent  results  in 
environments  when  the  decisionmakers  diagnosis 
of  situationally  caused  stress,  and  when  other 
components  of  the  contingency  task  structure, 
are  appropriate  for  these  forms  of  concrete 
operational  behavior.  In  unstructured  situa¬ 
tions  and  in  unfamiliar  environments,  a  for¬ 
mal  operational  mode  of  cognition  is  generally 
appropriate.  One  task  of  an  automated  system 
is  to  assist  decisionmakers  in  acquiring  the 
experience  and  situational  familiarity  appro¬ 
priate  for  cognizing  the  formal  operational 
thought  process  into  a  situation  where  con¬ 
crete  operational  thought  is  efficient,  effec¬ 
tive,  and  otherwise  appropriate.  Concrete 
operational  thought  typically  involves  use  of 
forward  processed  judgmental  heuristics  based 
upon  a  preceptive  mode  of  information  pro¬ 
cessing.  It  is  the  preferred  cognitive  style 
when  and  if  it  is  "fully  appropriate"  for  in¬ 
formation  processing  and  judgment.  Inferior 
cognition  and/or  poorly  perceived  concrete 
environmental  situations  may,  however,  result 
in  a  combination  of  information  processing 
biases,  poor  judgmental  heuristics,  and  value 
incoherencies  which  may  result  in  extremely 


poor  use  of  information  and  poor  aggregation 
of  facts  and  values,  perhaps  accomplished 
intuitively  and  wholistically,  to  form 
judgments  [1,4].  Extraordinarily  poor  con¬ 
crete  operational  thought  and  associated 
judgment  may  well  be  the  result  of  these 
maladies  which  may  be  very  effectively  re¬ 
inforced  through  feedback  to  create  an 
Outcome  Irrelevant  Learning  System  [9]. 

A  major  result  of  many  recent  studies  in 
behavioral  decisionmaking  is  that  by  no 
means  do  we  necessarily  learn  well  from  ex¬ 
perience  [10]. 

Thus  it  is  desirable  that  appropriately 
designed  automated  aids,  or  adjuvants,  for 
planning  and  decision  support  systems  be 
capable  of: 

.  assisting  in  the  evaluation  of  al¬ 
ternative  plans  and  course  of  action 
that  involve  formal  operational 
thought  processes, 

.  assisting  in  the  transfer  of  formal 
operational  situations  to  concrete 
operational  situations, 

.  assisting  in  evaluation  of  alterna¬ 
tive  plans  and  courses  of  action 
that  involve  concrete  operational 
thought  processes, 

.  assisting  in  the  avoidance  of  infor¬ 
mation  processing  biases  and  poor  • 
judgmental  heuristics, 

.  assisting  users  to  combine  cues  re¬ 
ceived  from  multiple  source  in  an 
appropriate  fashion, 

.  assisting  in  the  use  of  a  variety 
of  judgmental  heuristics  appropriate 
for  given  operational  environments 
as  natural  extensions  of  a  decision¬ 
maker's  normal  cognitive  style, 

.  assisting,  to  the  extent  possible, 
in  the  determination  of  whether 
a  formal  or  concrete  style  of  cog¬ 
nition  is  most  appropriate  in  a 
given  situation, 

.  assisting  decisionmakers  who  need  to 
use  formal  operational  thought, 
and  those  whose  expertise  allows 
appropriate  and  effect  use  of  con¬ 
crete  operational  thought,  to 
function  together  in  a  symbiotic 
and  mutually  supportive  way, 

.  assisting  decisionmakers  in  maxi¬ 
mizing  the  many  beneficial  aspects 
of  experiential  learning. 

Clearly  there  is  a  space-time  dependency 
associated  with  these  desired  capabilities. 

Also  among  the  many  concerns  that  dictate 
needs  and  requirements  for  automated 
systems  is  the  fact  that  decisionmakers 
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must  typically  make  more  judgments  and  asso¬ 
ciated  decisions  in  a  given  period  of  time  than 
they  can  comfortably  make.  This  creates  a 
stressful  situation  which  can  lead,  as  has 
been  noted,  to  the  use  of  poor  information  pro¬ 
cessing  and  judgmental  heuristics,  especially 
since  judgments  and  decisions  are  typically 
based  on  forecasts  of  the  future  and,  as  a 
consequence,  involve  uncertainties  and  risks. 

The  basic  requirement  for  an  aiding  procedure 
is  to  enhance  the  initial  acquisition  of-in- 
formation,  and  the  structuring  and  analysis 
of  the  information  received  from  multiple 
sources.  Objectives  associated  with  improve¬ 
ment  in  the  situation  extant  and  possible 
courses  of  action  will  also  be  identified. 
Typically  there  will  be  uncertainty  with 
respect  to  this  information  and  the  events 
likely  to  follow  from  various  alternative 
actions.  Additional  information  may  reduce 
this  uncertainty  but  can  only  be  obtained  at 
various  costs.  Determination  of  the  value  of 
additional  information  will  enable  determina¬ 
tion  of  whether  it  is  worthwhile  to  acquire 
and  analyze  it.  When  new  information  is  ob¬ 
tained,  it  is  aggregated  in  with  existing 
information.  Additional  information  is  ob¬ 
tained  if  it  is  believed  to  be  desirable,  that 
is  to  say  cost  effective,  and  is  processed  in 
a  similar  manner.  This  information  processing 
sequence  terminates  when  the  decisionmaker 
determines  that  it  would  be  non  cost  effec¬ 
tive  to  obtain  additional  information  [11]. 

This  can  occur  because  of  one  or  more  of  a 
number  of  considerations  and  constraints: 
temporal,  human  and  other  resource  limitations, 
etc.  When  information  acquisition  and  ana¬ 
lysis  finally  terminates,  information  evalua¬ 
tion  and  interpretation  is  accomplished  and 
a  judgment  or  decision  is  made.  There  have 
been  a  number  of  studies  of  human  information 
processing  [5]  which  generally  indicate  un¬ 
aided  information  processing  and  associated 
judgment  to  often  be  flawed. 

Not  only  is  there  a  need  to  solve  problems 
over  a  particular  planning  horizon,  but  it  is 
often  necessary  to  update  the  resulting 
solutions  "periodically"  as  better  informa¬ 
tion  is  obtained.  Thus  it  is  necessary  to  cope 
not  only  with  planning  horizons,  but  also  to 
update  solutions,  or  recommended  alternative 
courses  of  actions,  at  various  planning  periods. 
These  difficulties  are  further  confounded  with 
space  and  multiple  decisionmaker,  and  related 
organizational,  issues;  with  the  cognitive  style, 
experience,  and  contingency  task  structure 
related  determinants  of  human  information 
processing  and  judgmental  mechanisms;  and  with 
potential  information  processing  bias  and 
judgment  heuristics. 

Thus  we  see  that  there  are  indeed  formidable 
needs  and  issues  to  be  resolved  that  are  asso¬ 
ciated  with  the  design  of  information  pro¬ 
cessing  and  judgment  aiding  support  systems. 
These  relate  to  questions  concerning  appropria¬ 
te  functions  for  humans  to  perform.  They 
concern  the  type  of  information  which  should 


be  available  and  how  this  information  should 
be  acquired,  analyzed,  evaluated,  summarized, 
stored,  aggregated  and  presented  such  that 
it  can  be  used  most  effectively  in  a  variety 
of  potential  operational  environments.  They 
concern  design  of  information  systems  with 
strong  space-time-environmental  dependencies. 
They  concern  design  of  information  systems 
that  can  effectively  "train"  users  to  adapt 
and  use  appropriate  concrete  operational 
heuristics  in  those  environments  in  which 
inexperience  dictates  initial  use  of  the 
more  inefficient  and  time  consuming,  but 
potentially  more  effective  and  reliable, 
formal  operational  thought.  They  concern 
design  and  use  of  information  systems  that 
support  environmentally  experienced  users 
in  the  use  of  a  variety  of  effective  con¬ 
crete  operational  heuristics.  And  because 
of  use  of  the  system  by  multiple  decision¬ 
makers,  these  tasks  must  be  accomplished  in 
a  parallel  architectural  fashion. 


ORGANIZATIONAL  INFORMATION 
PROCESSING 

Keen  [12]  acknowledges  four  causes  of  inertia 
relative  to  organizational  information 
systems.  He  indicates  that:  information  is 
only  a  small  component;  human  information 
processing  is  experiential  and  relies  on 
simplification;  organizational  change  is 
incremental  and  evolutionary  with  large 
changes  being  avoided;  and  that  data  is  a 
political  resource  affecting  particular 
groups  as  well  as  an  intellectual  commodity. 
Each  of  these  suggests  the  importance  of  a 
knowledqe  of  the  way  in  which  information  is 
processed  by  organizations.  Only  with  a 
knowledge  of  descriptive  process  components 
of  information  processing  can  we  design 
useful  prescriptive  aids. 

Of  particular  interest  among  studies  con¬ 
cerning  information  processing  in  organiza¬ 
tions  is  a  large  body  of  literature  concer¬ 
ning  how  individuals  integrate  or  aggregate 
information  and  attribute  causes  [3j;  how 
various  ways  of  presenting  information  and 
how  various  cognitive  structures  influence 
behavior  [13];  how  decision  makers  deter¬ 
mine  information  requirements  and  associated 
analysis  techniques  [14] ;  and  how  the  actual 
process,  as  opposed  to  the  substance,  of 
judgment  and  decisionmaking  evolves  in  par¬ 
ticular  situations. 

Huber  [15]  and  Tushman  and  Nadler  [16]  have 
developed  a  number  of  propositions,  based 
on  their  own  research  and  upon  the  research 
of  others,  reflecting  various  aspects  of 
information  processing  and  -ssociated  deci- 
sionmakinq  in  organizati<- ...  ,.7],  In  an 
effort  to  enhance  efficiency,  organizational 
information  processing  typically  reouires 
selective  routing  of  messages  and  summa¬ 
rization  of  messages.  Huber  [15]  identifies 
six  variables  associated  with  the  routing 
of  messages.  Six  propositions  relative  to 
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message  routing  are  identified  and  associated 
with  these  variables.  Three  propositions  are 
associated  with  delay  in  messages,  eight  with 
organizational  message  modification,  and  four 
with  message  summarization.  Identification 
of  other  variables  which  influence  information 
processing  by  organizations  would  represent  a 
desirable  activity.  To  determine  how  these 
information  processing  variables  are  influ¬ 
enced  by  the  information  processing  biases  of 
individuals  would  seem  especially  desirable 
in  terms  of  the  likely  usefulness  of  the  re¬ 
sults  and  the  need  for  an  expanded  theory  of 
grouo  information  processing  biases.  There 
appears  to  have  been  only  limited  results  ob¬ 
tained  in  the  area  of  cognitive  information 
processing  biases  and  use  of  inferior  decision 
heuristics  on  the  part  of  groups. 


4.  backing  or  the  general  body  of 
information  that  is  presupposed 
by  the  warrant 

5.  modal  qualifiers  or  circumstances 
contingencies  or  restrictions 
which  will  have  to  exist  in  order 
that  the  warrant  truly  supports 
the  grounds 

6.  possible  rebuttals  or  circum¬ 
stances,  contingencies,  or  re¬ 
strictions  which,  if  they  exist, 
will  refute  or  diminish  the  force 
of  the  warrant  would  appear  to  be 
the  elements  of  interest  for 
development  of  structured  pro¬ 
tocols. 


Especially  noteworthy  concerning  results  that  A  simplified  block  diagram  of  the  interaction 

have  been  obtained  in  this  area  are  the  group-  among  these  elements  is  given  in  Fig.  1.  The 

think  studies  of  Jam's  and  Mann  [18].  Group-  information  processing  "structure,"  consi- 
think  is  a  collective  pattern  of  defensive  sting  in  part  of  the  decisionmakers  view  of 

avoidance,  a  concurrence  seeking  tendency  of  possible  and  probable  action  courses  and  the 

highly  cohesive  groups.  When  grouothink  occurs,  "decision  situation  model,"  is  specified  by 
people  develop  rationalizations  to  support  se-  elements  3-6.  Element  2,  the  "grounds,"  com- 

lectively  perceived  illusions  or  wishful  thin-  prises  the  situational  data  pertaining  to 

king  about  issues  at  hand  and  collectively  the  operational  conditions  extant.  The  claim, 

participate  in  development  and  use  of  a  element  1,  is  the  empirical  statement  which 

defensive  avoidance  pattern.  In  groupthink,  is  supported  by  other  elements  in  this  in- 
a  group  collectively  falls  victim  to  one  or  formation  processing  structure.  This  struc- 

more  of  the  many  cognitive  biases.  tured  information  processing  model  is  also 

sufficiently  general  to  accommodate  analy- 
Among  the  conditions  which  lead  to  groupthink  tical  hierarchical  inference.  Thus  it  may 

are:  high  cohesiveness,  insul-tion,  lack  of  well  provide  a  structured  framework  for  in- 

use  of  systemic  procedures  for  search  and  formation  processing  that  can  accommodate 

appraisal,  highly  directive  leadership,  and  a  variety  of  information  processing  styles 

a  contingency  task  situation  which  leads  to  and  approaches  and  be  appropriate  for  a 

high  stress.  Among  symptoms  of  groupthink  are:  variety  of  operational  environments  and  con- 
an  illusion  of  invulnerability,  collective  tingency  task  structures.  It  would  appear 

rationalization,  belief  in  inherent  group  mora-  to  so  structure  the  information  processing 
lity,  excessive  pressure  against  dissenting  framework  that  areas  where  additional  infor- 

views,  self  censorship,  illusions  of  unanimity,  mation  is  needed  can  be  identified.  Thus, 

and  members  who  shield  the  group  from  discon-  this  structured  framework  represents  a  corn- 

firming  information.  Nine  prescriptions  are  municable  plausible  way  of  capturing,  as  well 
offered  to  avoid  groupthink  by  Janis  and  Mann[18}as  explaining,  a  rather  complete  view  of  the 

belief  system  of  a  decisionmaker  with  respect 
A  major  difficulty  in  human  information  proces-  to  a  given  issue, 
sing  seems  to  be  failure  to  identify  and  use 

a*  appropriate  structure  that  allows  appropriate  Use  of  a  structured  information  processing 
weighting  of  observed  data.  It  is  both  the  format  may  reduce  the  tendency  for  message 

structure  and  the  content  within  the  structure  distortion,  perhaps  to  a  considerable  extent, 
that  determines  the  essence  of  a  decision  situ-  Mitroff  and  Mason  [20],  have  presented  some 
ation.  Investigation  of  the  effects  of  various  suggestions  concerning  use  of  structured 
structured  information  processing/decision  ai-  logical  reasoning  to  cope  with  ill  structured 
ding  frameworks  and  protocols  upon  the  acqui-  policy  problems  and  the  often  occurring  di- 
sition,  analysis,  and  interpretation  of  infor-  vergence  between  opposing  formulations  and 
mation,  and  its  integration  with  judgment  and  perceptions  of  large  scale  issues.  These 

decision  making  activities,  would  appear  to  be  appear  especially  relevant  to  the  design  of 

a  contemporary  need  in  information  system  knowledge  based  information  systems  for 

design.  There  are  six  elements  found  in  expli-  planning  and  decision  support.  Potentially 

cit  argument  [19]:  very  useful  results  are  obtained  by  using 

the  structure  and  logic  of  rational  argument 

1.  claims  or  hypotheses  to  develop  a  basis  for  detection  of  incon¬ 

sistencies  and  bias.  These  models  may  be 

2.  grounds  or  foundations  to  support  used  to  detect  inferences,  and  their  likely 

the  claims  consequences,  that  are  the  result  of  an  in¬ 

consistent  set  of  premises.  It  should  be 

3.  warrants  or  justification  for  the  possible  to  do  this  in  such  a  way  as  to  make 

grounds  or  foundations  explicit  those  inconsistencies  which  are  due 

to  different  perceptions  of  an  issue.  This 
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design  of  knowledge  based  systems  for  plan¬ 
ning  and  decision  support. 


aids  in  understanding  the  viewpoints  of  others 
as  well  as  providing  a  basis  for  determining, 
perhaps  by  assigning  a  quantitative  index  to, 
the  credibility  of  verbal  reports  and  quantita¬ 
tive  information. 

Information  processing  biases  that  occur  during 
formulation,  analysis  and  interpretation  of  in-  1. 
formation  are  influenced  by  a  number  of  factors; 
with  stress  and  the  contingency  task  structure 
being  among  the  dominant  influences.  Also, 
there  are  a  number  of  feedback  mechanisms  invol¬ 
ved  which  influence  these  biases  [3,9].  The  2. 

often  occurring  propensity  to  not  seek  di scon- 
firming  information,  and  consequent  reliance 
upon  positive  feedback  only,  leads  to  unwar¬ 
ranted  confidence  in  judgment  and  various  mala¬ 
dies  as,  for  example,  groupthink.  Also,  atten-  3. 
tion  to  content  in  messages  at  the  expense  of 
structure  may  result  in  the  logical  error  of 
denying  the  antecedent  statement  when  there  may 
be  no  information  whatever  that  supports  this 
inference.  There  are  at  least  four  related 
consequences  of  human  information  processing  4. 

limitations:  selective  perception  of  infor¬ 
mation  in  accordance  with  prior  expectations; 
improper  aggregation  of  information  cues  recei¬ 
ved  from  multiple  sources;  improper  use  of  feed-  5. 
back;  and  limited  and  faulty  memory  and  recall. 

To  avoid  these  limitations,  it  would  appear 
necessary  to  identify  and  analyze  potentially 
disconfirmation  evidence,  and  to  identify  and 
test  alternative  hypotheses,  using  all  available 
information.  This  must,  of  course,  be  accom¬ 
plished  within  an  appropriate  framework.  6. 

Information  formulation  biases  are  generally 
due  to  the  use  of  agenda  dependent  "editing"  or 
"framing"  rules.  Organizations  doubtlessly 
utilize  somewhat  similar  editing  and  framing  7. 

rules  in  their  transmission  of  messages.  A 
number  of  these  have  been  suggested  by  Tversky 
and  Kahneman  [21,22]  and  others.  It  is  on  the 
basis  of  scenario  descriptions  and  summaries 
that  issues,  and  prior  statistics  for  infor-  8. 

mation  processing,  are  determined.  One  of  the 
fundamental  claims  of  prospect  theory,  and 
related  theories,  is  that  these  editing  or 
framing  rules  lead  to  agenda  dependent  infor¬ 
mation  formulation  and  related  information 
acquisition.  Knowledge  of  editing  rules  used  9. 
in  a  given  situation  will  generally  allow  de¬ 
termination  of  a  set  of  debiasing  procedures. 

It  is  quite  possible  that  various  structured 
procedures  and  protocols,  based  upon  a  set  of 
required  specifications  to  determine  information  10. 
formulation  needs  for  reasoning  models  could 
serve  as  useful  adjuvants  to  the  effective  de¬ 
termination  of  "proper"  editing  and  summariza¬ 
tion  rules  which  avoid  various  error  formu-  11. 

lation  biases.  In  effect,  the  structured  frame¬ 
work  would  become  a  normative  framing  and  edi¬ 
ting  guide  for  decision  situations. 

12. 


SUMMARY 
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Abstract.  We  present  an  iterative  and  interactive  aonroach  to  aid  a 
decisionmaker  in  selecting  an  alternative  from  a  finite  set  of  alternatives 
under  conditions  of  outcome  uncertainty.  This  approach  allows  parameters, 

i.e.,  probabilities  and  utilities,  to  be  described  imprecisely.  The  decision¬ 
maker  can:  determine  the  imoact  of  imprecise  Darameter  values  on  alternative 
rankinq,  determine  the  implications  of  a  who! istically  determined  alternative 
rankinq  on  oarameter  values,  and  elect  to  more  precisely  describe  the  values 
of  the  Darameters.  The  intent  of  iteratively  oerforminq  these  three  tasks  is 
to  determine  descrintions  of  oarameter  values  and  an  alternative  ranking  that 
are  acceotable,  consistent,  and  support  the  selection  of  the  most  preferred 
alternative. 


INTRODUCTION 

In  this  paper,  we  consider  the  issue  of  helning 
a  decisionmaker  select  a  sinqle  alternative 
from  a  finite  set  of  alternatives  under  condi¬ 
tions  of  outcome  uncertainty.  A  normative  ap- 
oroach  is  taken  which  is  based  on  the  maximiza¬ 
tion  of  expected  utility.  Three  key  characte¬ 
ristics  of  the  apDroach  are: 

1.  probabilities  and  utilities  may  be 
imprecisely  described  as  being  mem¬ 
bers  of  given  sets, 

2.  the  ultimate  goal  of  the  analysis 
is  to  provide  only  enough  alterna- 

#  tive  rankinq  information  in  order 

to  sucport  the  decisionmaker's 
desire  to  select  the  most  preferred 
alternative, 

3.  the  decisionmaker  is  allowed  to 
iteratively  provide  information 
about  the  orobability  and  utility 
values,  examine  the  impact  of  this 

.  information  on  alternative  rankinq 
and  adjust  and  auqment  the  para¬ 
meter  information  as  needed  in 
order  to  roduce  a  desired  alter¬ 
native  ranking. 

These  three  characteristics  distinguish  ou>> 
anoroach  from  multiattribute  decision  analysis 
(DA),  as  described,  for  example  in  Keeney  and 
Raiffa  (1976).  The  DA  paradigm  typically  re¬ 
quires  orecise  probability  and  utility  initially 
and  then  examines  the  impact  of  parameter  im¬ 
precision  on  ootimalitv  via  a  standard  oost-op- 
timality  analysis.  As  indicated  by  the  first 
characteristic,  we  allow  parameters  to  be  im¬ 


precisely  described  initially,  thus  essen¬ 
tially  eliminating  the  need  for  oost-optima- 
lity  analysis. 

The  result  of  a  DA  exercise  is  a  total  orde¬ 
ring  of  the  alternatives.  Such  alternative 
rankinq  specificity  may  be  more  than  is  neces¬ 
sary  in  order  to  support  the  decisionmaker's 
selection  of  a  most  preferred  alternative. 

For  example,  physicians  diagnosing  a  common 
ambulatory  complaint  found  it  quite  satisfac¬ 
tory  to  have  10  to  12  diagnostic  tests  elimi¬ 
nated  from  a  total  number  of  14  orior  to  test 
selection  (White,  C.C.,  E.C.  Wilson  and  A.C. 
Weaver,  1982).  As  indicated  by  the  second 
characteristic,  we  do  not  necessarily  reouire 
the  assessment  of  information  sufficient  to 
determine  a  total  order  on  the  alternatives, 
which  tends  to  reduce  our  data  needs  relative 
to  DA. 

The  third  characteristic  suqgests  two  features 
of  our  approach: 

1.  the  decisionmaker,  rather  than  a 
paradigm  iteratively  selects  how 
much  alternative  rankinq  specifi¬ 
city  is  necessary  for  alternative 
selection. 

2.  the  decisionmaker  is  allowed  to 
(a)  qo  back  and  adjust  informa¬ 
tion  reqarding  probability  and 
utility  values  if  those  values 
produce  a  counterintuitive  alter¬ 
native  ranking  and/or  { b)  read¬ 
just  his  wholistic  view  of  how 
the  alternatives  should  be  ran¬ 
ked  on  the  basis  of  the  impact 
of  parameter  values  on  alternative 
ranking. 


The  decisionmaker  therefore  has  substantial  con¬ 
trol  over  how  the  decision  aiding  process  evol¬ 
ves,  a  fact  which  presumably  enhances  decision 
aid  acceptability.  This  and  other  behavioral 
and  organizational  considerations  important  in 
the  desiqn  of  decision  support  systems  are  dis- 
dussedin  (Sage,  1981). 

Ue  beqin  by  formulating  the  decision  aiding 
problem  and  specifying  the  types  of  information 
assumed  to  be  available  for  its  resolution.  We 
state  our  model  of  parameter  imprecision  and  * 
present  a  quadratic  program  which  determines  an 
alternative  ranking  based  on  this  parameter  im¬ 
precision.  Our  approach  to  decision  aidinq  is 
then  presented.  It  can  involve  the  determina¬ 
tion  of  a  description  of  parameter  values  based 
on  a  wholistic  alternative  ranking,  which  we 
call  the  inverse  decision  aiding  problem  and 
which  we  at  least  partially  analyze.  These  re¬ 
sults  are  illustrated  by  examples.  Conclusions 
of  our  results  are  then  presented. 


PROBLEM  FORMULATION 

A  single  alternative  is  to  be  chosen  from  a  fi¬ 
nite  set  of  alternatives  A.  Once  an  alternative 
is  selected,  a  single  consequence,  from  a  finite 
set  of  consequences  C,  will  result.  The  problem 
objective  is  to  select  the  most  preferred  alter¬ 
native  from  A. 


SOURCES  OF  INFORMATION 

Ue  consider  two  possible  sources  of  information 
useful  in  selecting  the  most  preferred  alterna¬ 
tive:  direct  information  and  indirect  informa¬ 
tion.  Each  type  of  information  is  described  as 
a  relation  on  A.  R_  represents  the  presumably 
transitive  relation  determined  by  direct  infor¬ 
mation  and  R.  renresents  the  relation  determined 
by  indirect  information.  The  pair  (a',a)cR0  if 
and  only  if  the  decisionmaker  is  willing  touwho- 
listically  state  a  preference  for  alternative  a' 
relative  to  alternative  a. 


PROBABILITIES  AND  UTILITIES 


The  determination  of  R,  requires  more  structure. 
Let  o(a,c)  represent  the  probability  of  conse¬ 
quence  c  occurrinq,  given  that  alternative  a  was 
selected.  We  assume  p(a,c)  >  0  for  all  aeA  and 
CcC  and  that  r  Cp(a,c)=l  for  all  asA.  Let 
u(a,c)  reDresertt''the  utility  of  selecting  alter¬ 
native  a  and  receiving  consequence  c.  We  assume 
that  min.  .  u(a,c)=0  and  max  u(a,c)=l  for 


all  CcC. 


acA 


PARAMETER  IMPRECISION 

Expected  utility  will  serve  as  the  basis  for 
determining  R.;  however,  we  will  assume  that  the 
probabi 1 i ties]and  utilities  may  not  be  precisely 
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known.  The  justification  of  this  assumption 
is  as  follows.  Facts,  represented  by  pro¬ 
babilities,  may  not  be  known  precisely  due  to 
large  confidence  intervals,  if  the  probabili¬ 
ties  are  statistically  determined,  or  due  to 
lack  of  consensus  or  confident  expertise,  if 
the  probabilities  are  subjectively  deter¬ 
mined.  Values ,  represented  by  utilities,  may 
not  be  known  precisely  because  the  decision¬ 
maker  may  not  want  to  explicitly  reveal  pre¬ 
ferences  for  a  variety  of  reasons,  e.g.,  le¬ 
gal,  Dolitical,  personal.  Lack  of  time  neces¬ 
sary  for  parameter  assessment  also  represents 
a  possible  barren  to  precise  parameter  value 
determination. 

We  dgscribe  parameter  imprecision  as  follows. 
Let  C  represent  the  total  number  of  possible 
consenuences ,  i.e.,  card  ( C ) =” C ,  u(a)  =  row 
[u(a.l ),...,  u(a,rC)],  and  p(a)=col  [ p( a ,  1 ) , . . 
p(a,  C)].  Assume  for  each  pair  (a'.a)eAxA, 
a'j*a,  there  is  a  set  U(a',a)  and  a  set 
P(a',a).  U(a',a)  represents  constraints  on 
u(a')  and  u(a),  i.e.,  Lu(a'),  u(a)]eU(a'  ,a), 
and  P(a',a)  represents  constraints  on  p ( a  * ) 
and  p(a),  i.e.,  [p(a'),  p(a)]cP(a‘ ,a).  The 
following  example  illustrates  the  usefulness 
of  these  descriptions  of  parameter  imprecision 

EXAMPLE  1.  A  physician  must  decide  whether 
to  operate  (OP)  or  to  treat  with  druqs  (T), 
i.e.,  A={OP,T).  Two  consequences  are  possible 
bad  (B)  and  good  (G),  i.e.,  C={B,G}.  If  the 
consequence  is  good,  it  is  better  to  have 
intervened  as  little  as  possible;  however,’ 
if  the  consequence  is  bad,  more  intervention 
would  be  perceived  as  better.  Thus, 
0=u(T,B)<u(0P,B)<u(0P,G)<u(T,GH,  and  U(T,OB) 
represents  the  set  of  alT  utility  values  that 
can  satisfy  these  (linear)  inequalities.  The 
probability  of  a  good  consequence  is  enhanced 
by  the  operation.  Therefore,  p(OP,B)<j>(T,B) , 
and  P(T,OB)  represents  the  set  of  all  proba¬ 
bility  values  that  can  satisfy  this  (also 
linear)  inequality. 


DEFINITION  AND  DETERMINATION  OF  Rj 

We  can  now  define  R,:  (a',a)cR,  if  and  only 

if  u(a ' )p(a ' )>u(a)p(a )  for  all 
Lu(a' ),u(a)]cU(a' ,a)  and  [p(a'),  p(a)]cP(a 1 ,a) 
We  observe  that  if  U(a',a)  and  P(a',a)  repre¬ 
sent  linear  constraints,  then  (a’.ajeR,  if 
and  only  if  the  optimal  value  of  the  criterion 
of  the  following  quadratic  program  is  non¬ 
negative: 

minimize:  u(a' )p(a '  )-u(a)p(a) 

subject  to:  [u(a ' )  ,u(a)]eU(a 1  ,a ) 
[p(a‘),p(a)]eP(a' ,a). 

We  observe  that  if  either  orobabilities  or 
utilities  are  known  precisely,  the  ouadratic 
programs  become  linear  programs.  Unfortunate¬ 
ly,  Kuhn-Tucker  conditions  for  these  ouadra¬ 
tic  programs  are  only  necessary,  an  easily 
shown  fact,  and  hence  their  use  will  produce 
only  an  upper  bound  Rj  on  Rj,  i.e.,  RjCRj. 


Use  of  this  quadratic  programming  procedure  is 
illustrated  in  the  following  example. 

EXAMPLE  2:  Consider  the  case  where  A={1 ,2,3,4), 
C=iB,G},  p -=p( i ,B) ,  and 

P4  1  P3  1  p2  -  pl*  p4  -  0J 
0  =  u(4,B)  <  u(3,B)  <  u(2,B)  <  u(l,B) 
u(l,B)  <  u ( 1  ,G) 

u(  1  ,G)  <_  u(2,G)  <  u(3,G)  <  u(4,G)  =  1 
u(3,B)  =  0.1,  u(2,B)  =  0.2 
0.8  <  u(3,G)  <  0.9 
0.5  <  u(2,G)  «  0.6. 

This  example  represents  an  extension  of  Example 
1  for  the  case  where  there  are  four  available 
alternatives  and  where  certain  additional  re¬ 
strictions  on  the  parameters  are  given  as  above. 
Presumably,  we  have  been  able  to  assess  an  upper 
bound  on  p4,  exact  values  for  u(3,B)  and  u(2,B), 
and  bounds  on  u(3,G)  and  u(2,G).  Use  of  stand¬ 
ard  quadratic  programming  software  indicates 
that  R.  =  {(4,2),  (4,3)}.  Routine  algebraic 
analysis  confirms  that  R.  =  R.;  that  is,  alter¬ 
native  4  dominates  alternatives  2  and  3  and  al¬ 
ternatives  1  and  4  are  nondominated.  Hence, 
alternatives  1  and  4  are  possible  contenders  for 
the  most  preferred  alternative. 


AN  ITERATIVE  PROCEDURE  FOR  DECISION 
AIDING 

For  the  case  where  R,  represents  the  basis  for 
alternative  selection,  the  following  iterative 
procedure  has  been  suggested  for  decision  aiding 
(White  and  Sage,  1980;  White,  Sage  and  Scherer, 
1981): 

IP1:  1.  Assess  U  ( a '  ,a )  and  P(a',a)  for 

•  all  (a' ,a)cAxA,  a'/a. 

2.  Determine  Rj. 

3.  If  an  alternative  can  be  selected 
from  the  nondominated  set  genera¬ 
ted  by  R,,  then  stop.  If  not, 
assess  more  precise  parameter  in¬ 
formation,  update  U(a',a)  and  . 

•P(a',a)  for  all  (a1, a),  and  go  to 
Step  2. 

Generally,  but  not  always,  more  precise  para¬ 
meter  information  produces  an  R.  with  a  smaller 
nondominated  set,  which  presumably  enhances  al¬ 
ternative  selection.  Thus,  the  decisionmaker 
provides  parameter  value  information,  examines 
the  resulting  nondominated  set,  and  then  pro¬ 
vides  additional  parameter  value  information 
if  the  nondominated  set  is  too  large  for  alter¬ 
native  set. 

The  availability  of  Rg  suggests  the  following 


modification  of  the  above  iterative  proce¬ 
dure: 

IP2:  1.  Assess  RQ  and  parameter  value 

information,  and  determine  Rj. 

2.  Combine  R^.  and  R.  to  produce  a 
new  relation,  R,  on  A. 

3.  If  an  alternative  can  be  selected 
on  the  basis  of  R,  then  stop.  If 
not,  assess  more  wholistic  and 
parameter  value  information,  re¬ 
determine  R-.  and  R.,  and  qo  to 
Step  2.  u  1 

We  remark  that  by  encouraging  the  decision¬ 
maker  to  revise  wholistic  preferences  among 
alternatives,  i.e.  to  revise  R-,  we  are  su¬ 
bjecting  the  associated  knowledge  base  to  a 
learning  effect,  which  in  general  should 
improve  the  quality  of  human  judgment.  It 
is  not,  at  present,  clear  what  protocols  to 
use  in  order  to  best  accomplish  Step  2.  We 
feel,  however,  that  potentially  valuable  com¬ 
ponents  of  Step  2  are  comparinq  R-  to  R.,  ' 
examining  the  implications  of  RD  in  tentis  of 
parameter  value  information,  and  possibly 
revising  the  parameter  value  information 
and/or  R..  due  to  learning  effects.  Such  a 
procedure  clearly  puts  the  decisionmaker  in 
more  control  of  the  decisionmaking  process 
than  does  IP1.  Support  for  the  claim  that 
such  an  occurrence  enhances  potential  user 
acceptability  can  be  found  in  Adelman  and 
others  (1982)  and  Beach  (1975).  We 
now  examine  a  key  substep  of  Step  2  in  IP2: 
the  determination  of  parameter  value  infor¬ 
mation  that  generates  a  given  relation  on 
the  alternatives. 


INVERSE  DECISION  AIDING 

Assume  that  we  wish  to  determine  conditions 
on  the  parameters  that  would  produce  a  given 
relation  R,  which  we  refer  to  as  the  inverse 
decision  aiding  problem.  Clea.ly,  u(a)  and 
p(a),  acA,  must  be  such  that  if  (a'.a)eR, 
then  u(a')p(a‘)  >  u(a)p(a).  One  of  our  mo¬ 
tivations  in  examining  the  inverse  decision 
problem  is  to  find  elements  (pairs  of  alter¬ 
natives)  in  Rp  that  generate  acceptable  con¬ 
straints  on  tne  parameters  additional  to 
those  constraints  assessed  from  the  decision¬ 
maker.  Additional  constraints  tend  to  make 
the  parameter  values  more  precise,  which  in 
turn  tends  to  make  the  nondominated  set  asso¬ 
ciated  with  R.  smaller  and  hence  more  help¬ 
ful  in  the  alternative  selection  process. 

The  procedure  that  we  earlier  proposed  for 
determining  R.  was  based  on  the  assumption 
that  the  constraints  on  the  parameters  were 
linear.  We  therefore  prefer  that  a  given 
relation  R  would  produce  linear  constraints 
on  the  parameters.  Additionally,  it  may  be 
easier  for  a  decisionmaker  to  understand  the 
factual  and/or  preferential  meaning  of  linear, 
rather  than  nonlinear,  constraints  on  the 
parameters. 
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If  lowest  level  attribute  scores  and  probabili¬ 
ties  are  known  precisely  for  problems  involving 
multiple  objectives  and  an  additive  utility 
function,  then  linear  inequalities  can  be  de¬ 
termined  on  the  tradeoff  weights.  That  is,  if 
p(a)  is  precisely  known  for  all  acA,  u{a)  = 
r  >  u  (a)  =  \u (a )  for  all  a;A,  and  the  appro¬ 
priately  defined  matrix  u(a)  is  precisely  known 
for  all  atA,  then  ( a ’ , a )  eP.  implies  x[u(a' ) p( a '  )- 
p(a)]  >  0.  Linear  inequalities  can  also  result 
under  conditions  involving  some  knowledge  of 
parameter  values,  as  we  illustrate  in  the  fol¬ 
lowing  example. 

EXAMPLE  3:  Assume  A  =  {1,2,3,41,  C  =  (B.G1. 
and  R  =  {(4,3),  (4,2)}.  We  wish  to  determine 
what  conditions  on  the  parameters  must  be  satis¬ 
fied  in  order  for  RcR,.  First,  consider  the 
assumption  that  (4,J)£ft.  This  assumption  holds 
if 


procedure  for  identifying  precise  tradeoff 
weights  based  on  an  application  of  regres¬ 
sion  analysis  to  wholistic  preferences  among 
alternatives.  An  outstanding  unresolved 
issue  is  how  to  deal  with  the  situation 
where  a  set  of  probabilities  and  utilities 
and  a  relation  on  the  alternatives  exist 
that  are  believable  to,  perhaps  even  advo¬ 
cated  by,  the  decisionmaker  yet  are  not  con¬ 
sistent. 


The  reported  research  has  been  supported  by 
ONR  Contract  N0014-80-C-0542,  work  unit 
number  N1 97-065. 
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ABSTRACT 

This  paper  describes  a  sensitivity  based 
interactive  top  down  proceoure  that  will  allow 
identification  of  the  structure  of  an  attribute 
tree,  elicitation  of  attribute  weights  and 
alternative  scores  on  lowest  level  attributes 
ir.  such  a  way  as  to  ultimately  result  in  evalua¬ 
tion  of  alternative  courses  of  action. 


INTRODUCTION 

For  a  variety  of  reasons  a  decisionmaker  may 
be  unwilling  or  unable  to  provide  the  precise  in- 
•Cc~,-ct'irn  that  is  necessary  to  assess  utilities 
anc  identify  preferences.  Generally,  this  com¬ 
plicates  tne  search  for  a  dominance  structure  that 
enables  selection  of  a  single  nonoominant  alterna¬ 
tive,  frcr  a  mutually  exclusive  set,  for  imple- 
"•Mtatior.  action  (0-6).  In  order  tc  code  with  this 
Possibility,  we  have  developed  a  procedure  for 
alternative  evaluation  that  allows  for  elicitation 
tf  a  decision  situation  structural  model  and  iden¬ 
tification  of  imprecise  parameters  within  this 
ftr.cture  (6-12).  These  imprecise  parameters  may 
'".Present  event  outcome  probabilities,  alternative 
pe'fprmance  scores  on  attributes,  and  tradeoff 
'•eights  across  attributes. 

‘n  this  caper,  we  present  a  proceoure  for 
e'nar.cir.g  tne  assessment  of  a  top  down  structure, 
tne  parameter  information  within  this  structure, 

'or  a  hierarchical  tree  cf  attributes.  We  assume 
any  probabilities  associatec  with  event  out- 
"J~es  are  precisely  known.  For  ease  in  presenta- 
ticr,  we  will  illustrate  Our  results  only  for  the 

’‘his  researen  was  supported  by  the  Office  of 
Naval  Research  under  Contract  N003H-80-C-05A2 . 


certain  case.  However  our  results  apply  equally 
well  to  the  risky  case. 

The  interactive  decision  support  problem  for¬ 
mulation  is  presented  in  the  next  section.  The 
third  section  develops  the  approach  to  top  down 
aiding  and  presents  an  illustrative  example.  Con¬ 
clusions  are  presented  in  the  final  section. 

PROBLEM  FORMULATION 

We  consider  a  normatively  based  model  of  deci¬ 
sion  making  under  risk.  We  assume  that  there  exists 

A  alternative  courses  of  action  a,,  i*l ,2 . A. 

When  an  alternative  a^  is  selecteo.one  of  C  conse¬ 
quences,  x,(a^),  i'1,2 . C  occurs.  Consequence 

x^  follows’frem  a^  with  probability  p(x^|Sj)  * 

pjfaJ.  Tbe  utility,  or  bliss,  associated  with 
consequence  x.(a<)  is  denoted  U(xi,aj).  We  assume 

that  the  conditions  for  additive  independence  are 
satisfied  such  that  the  substantive  criterion  of 
choice  that  any  sensible  person  should  follow  is  to 
evaluate  the  subjective  expected  utility(SEu)of  al¬ 
ternative  a.  given  by 
C1 

EU(ai )  *  IKXj.a^pUjla^  (1) 


for  i«l,2,...,A,  and  select  the  alternative  with  the 
largest  SrU.  Often  the  decisionmaker  will  find  it 
difficult  to  specify  the  single  scalar  utility 
associated  with  implementing  a.  and  receiving  con- 
seouence  x..  When  the  additive  utility  conditions 
hold,  we  can  write  the  scaler  total  utility  of 
implementing  option  a-  and  receiving  consequence 
x.  ( a j )  in  terms  of  N  Components 


U  ( x 


(2) 


where  c.  is  the  tradeoff  weight  associated  with  the 

*■  tw  ^ 

kL  attribute.  Generally  it  is  helpful  to  define 
outcome  states  x.  that  are  functionally  independent 
of  alternative  a^.  Then  the  utility  function  will 
be,  functionally,  alternative  independent.  It  is 
particularly  desirable  to  accomplish  this  modeling 
since  this  will  insure  that  the  importance  weights, 
the  y ,  will  not  be  alternative  dependent.  In  this 

representation  we  have  a  conmon  set  of  outcome  states, 
x^,  for  ell  alternatives.  We  are  then  assured  that 
ttie  weights,  are  alternative  independent.  If 
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this  modeling  is  not  accomplished,  assessment  of 
utilities  ano  weights  can  become  a  very  tedious, 
although  certainly  not  impossible, task. 

With  this  assumption,  our  expected  utility 
expression  becomes  in  scalar  notation  and 
in  somewhat  more  convenient  vector-matrix  form, 

N  C  - 

Et'ieJ  *  l  7  2i,ukiM8i)  *  »  uP<ai)  (3) 

kr 1  j  =  l  *  J  1  1 


We  assume  that  the  conditional  probabilities 
U.j )  -  pjx^la.)  are  all  known  precisely.  The 
utility  components,  u.-,  may  be  precisely  known 
or  may  be  impreci sely  Known  with  the  imprecision 
expressed  by  inequalities 


Cj  -  Ukj  -  ej 

where  o.  and  may  be  numbers  or  linear  functions 

of  tne  t  ,  for  ?n*T,2 ...  - , C.  It  is  very  important 

to  note  that  our  linear  utility  inequalities  must 

be  expressed  within  attributes.  Thus  u.  .  cannot 

be  expressed  as  a  function  of  u for  k*?  n. 

nm 

T .ii s  is  behavioral  ly  realistic.  It  would  be  dif¬ 
ficult  to  imagine  utility  assessment  across 
attributes. 

In  a  similar  way  we  assume  that  the  attri¬ 
bute  tradeoff  weights  are  expressable  by  linear 
ineoual ities  of  the  form  Os  +  e  >  0,  subject 
N 

Of  course  to  T  c,*l,  c,  >  0.  Generally  it  is 
k?l  k  k  " 

oesirable  that  we  obtain  fixed  numerical  limits 
for  probabilities  and  utilities  in  the  form 

u^  «_  fj  and  <  ck  <  n^.  Linear  equalities 

such  as  :.<c,<  c,  and  u.,  <  u.  -  <  u.  ,  are 
i  —  2  —  3  k>  —  k2  —  k3 

cuite  acceptable  mathematically  but  purely 
ore' rial  specifications  such  as  these  may  well 
c'Tvev  such  great  imprecision  that  it  is  net 
possible  to  establish  any  meaningful  dominance 


We  can  now  write  the  minimum  and  maximum 

values  cf  E Li ( a ) .  We  obtain 
j 

N 

isJ(aJ  '  min  EU(aJ  *  min  7  c,V.(a.)  (<) 

:,U  '  p  k*l  1 


w.iere  \\  (a.)  “  min  7  u|t1p-(ei) 


for  k*l,2,...,K.  We  can  minimize  the  expression 
for  V.  term  by  term  only  because  of  tne  assump¬ 
tion  that  we  express  set  inequalities  in  u  .  only 
within  attributes  and  not  across  attributes!  In 
a  similar  way  we  have 


rU(a.. )  *  max  EU(a-)  *  max  \  ‘^k^i^ 
u.U  e  k=l 


where  V.(a.)  *  max  7  u..p.(a.] 
k  1  u.  .,  j*l  J  1 


Despite  the  Dossible  utility  and  weight  para¬ 
meter  imprecision  we  can  say  with  certainty  that 
alternative  a,  is  preferred  to  alternative  a 

•  in 

(a.  }  am)  if  and  only  if 

min[EU(a ■ )  -  EU(am)]  >_  0 
p,U 

Using  the  definition  cf  SEU  in  Eq.  (3)  in  the  fore¬ 
going  results  in 


ffi1n  J.^k^i'^i0  (8) 

p  K=  I 

c 

where  V^a-.aJ  *  min  .1  (9) 

°kj 

It  is  a  simple  matter  to  show  (4)  that 

min[EU(a . )-EU(a  )]  ^  mi..  EU(as)-max  EU(u  ) 
p,u  *"  c.u  p  ,u 

It  might  be  temptino  to  believe  that  we  could  de¬ 
termine  whether  a.  }  a  bv  checking  to  see  whether 
EU  (a.)  >  EU(am)  wheremEU(a.|- )  =  min  EU(  )  and 
__  p.u 

riJla^)  =  max  EUla^.  If  EUla^)  >_  EU(am)  <>*  have 

P  *  u 

sufficient*  but  not  necessary  conditions  for 
a •  }  a  Using  this  relation  will  guarantee_con- 
servatism.  If  we  determine  that  EU(&. )  >  EU(a_) 

-  1  —  IT) 

we  know  for  sure  that  a^  )a  ,  but  the  converse  is 
not  necessarily  true.  We  point  this  out  here  since 
we  will  generally  wish  to  use  EU(a-)  and  EU(as)  as 
displays  to  the  decisionmaker  to  assist  in  the 
attribute  tree  structuring  effort.  1*  will  be  a 
very  useful  guide,  but  cnly  a  guide.  Large  diffe¬ 
rences  between  EU(e^)  and  EU(a.)  at  any  attribute 
suggest  that  it  is  advantageous  to  disaggregate  the 
tree  from  that  attribute  node  downward  in  an  at¬ 
tempt  to  get  greeter  parametric  precision. 

The  certain  outcome  case  is  a  special  subset 
of  the  results  presented  here  thus  far.  Alterna¬ 
tive  a.  leads  to  outcome  x.  with  certainty  and  CrA. 
We  use’p.U.)  *  Atj  where  £,.  ^a.)  is  the 
Kronecker  delta  "dnction.  Equatidns  (5),  (7)  and 
(S)  become 

V^Ui)  =  min  Me.)  *  u^) 

V£i} 

\(a.)  =  max  )  =  Vei 5 

uk(ai) 

uk(ii)’uk{£m) 
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where  uk(a.)  *  u^U,)  |js. 

When  the  inequalities  on  u. { 6 ^ ^ 
only  we  obtain  1 


are  a  set  of  numbers 


attribute  tree  shown  in  Figure  1.  We  do  not  assume 
that  the  entire  tree  is  known  prior  to  the  elicitation 
effort  but  merely  pose  this  now  to  avoid  sketching 
several  partial  trees. 


V4i’*m>  S^6i>-W 

but  we  caution  that  this  still  results  in  the 
inequality 

min  cTtu(a,)-u(a  )]  =  min  cTV.{a.,a  )  > 

t.uUjhuteJ  1  m  o  k  !  m  - 

N  N 

rin  I  ckJ*k(ai)‘max  J  pfcu.(a  ) 
c  k*l  1  c  k«l  *  *  1,1 

rather  than  an  equality  between  these  expressions. 


THE  ATTRIBUTE  TREE  STRUCTURING  PROCEDURE 

In  some  approaches  to  attribute  tree  struc¬ 
turing  it  is  assumed  that  all  attributes  have  been 
identified  and  related  to  one  another  through  the 
contextual  relation  "is  included  in".  While  this 
approach  certainly  works,  there  is  no  way  prior  to 
const~ct*ng  the  structure  and  parametari2ir.g  it 
to  know  that  the  tree  is  too  deep  in  the  sense  of 
more  attributes  being  included  than  are  really 
needed  to  meaningfully  characterize  the  utility 
function.  The  approach  described  here  is  a  sen¬ 
sitivity  based  approach  (2,4,5)  in  which  sensitivity 
is  interpreted  by  means  of  the  parameter  precision 
wnich  the  decisionmaker  expresses.  This  is  used  to 
guide  the  attribute  tree  structuring  such  that  a 
more  or  less  minimal  but  sufficiently  complex 
tree  structure  results. 


Suppose  there  are  4  non  dominant  alternatives 
initially  identified.  The  decisionmaker  elects  to 
do  a  top  down  evaluation.  Three  attributes  are 
initially  identified.  The  decisionmaker  initially 
identifies  the  following  scores  on  the  three  first 
level  attributes,  where  a  -  b  indicates  that  the  score 
may  vary  from  a  to  b. 

Attribute  Scores 


Initially  we  assume  that  the  decisionmaker 
cannot  select  wholistically  from  among  A  attributes. 
Two  or  more  attributes  next  to  the  top  of  the  tree 
are  identified,  such  as,  for  example,  cost  and 
effectiveness.  The  decisionmaker  expresses  an 
initial  belief  in  the  range  of  costs  and  effective¬ 
ness  to  be  expected  from  identified  alternatives, 
and  a  range  of  importance  weights  expressing  per¬ 
ceptions  concerning  tradeoffs  among  these  attri¬ 
butes.  It  may  well  be  that  this  is  sufficient  to 
identify  a  single  non-dominant  alternative.  More 
cften  then  not*  this  will  not  be  possible.  Cal¬ 
culations  of  the  differences  between  maximum  and 
minimum  performance  for  each  alternative  on  each 
attribute  suggest  the  direction  of  tree  expansion 
most  likely  to  yield  significant  changes  in  al¬ 
ternative  preference  specificity.  Even  when  c 
single  non  dominant  alternative  has  beer,  found, 
it  is  often  advisable  to  extend  the  tree  one  level 
lo-er  anc  then  aggregate  up  the  tree  or  do  a  con¬ 
ventional  v.AUT  assessment  (1.3)  as  a  check  on  the 
veracity  cf  tne  structuring  and  parameterization 
effort. 

The  Prescribed  approach  is  perhaps  best 
illustrated  by  means  of  an  example. 


A  SIMPLE  EXAMPLE 

Suppose  that  the  decisionmaker  perceives  the 


Alternative  u°(a.) 

a,  0.3  ■*  0.6 

a?  1 
a,  0.4  -  O.S 


u2(ai)  ' 

U°3(8i) 

0 

1 

1 

0 

(1.2  -  0.3 

0.3  *  0.6 

0.6  •*  0.7 

00 

o 

1 

o 

We  note  that  there  is  little  imprecision  over  scores 
on  attribute  w£.  But,  there  is  considerable  impre¬ 
cision  over  the  other  to?  level  attributes.  If  the 
decisionmaker  cannot  identify  a  unique  best  and 
unique  worst  alternative  on  each  attribute,  the 
attributes  are  generally  in  need  of  redefinition. 
If  this  is  infeasible,  surrogate  best  and  worst 
alternatives  should  be  introduced.  In  terms  of  the 
difference  between  best  end  worst  scores  on  each  of 
these  three  attributes,  suppose  that  the  decision¬ 
maker  initially  identifies  ranoes  for  the  swing 
weights  as  *  0.3  and  <_  w°  <3w?.  Then  we  ask 

if  the  interpretation  C.35  <  »°  <  .467,  w^  =  0.3, 
and  0.233  <_  w^  <  0.35  is  a  reasonable  set  of  bounds. 

The  decisionmaker  agrees  and  then  we  compute,  using 
Eqs.  (4)  through  (7),  the  minimum  and  maximum  ranges 
for  the  composite  scalar  utility 
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Alternative  u° { ) 

Ufa- )  . 

a-j  0.56 

Alternative 

min  max 

a2  0.60 

*1 

0.3731  -  0.56 

a.  0.43 

i 

£2 

0.65  -  .767 

a4  0.21 

a3 

e. 

0.305  -  .65 

0.2033  -  .50 

Generally,  these  agree  with  the  results  obtained 
earlier.  And  the  value  scores  are  precise  now. 

But  we  had  best  be  careful  in  using  the  old  weights 

Figure  2  -  Domination  Digraph  After 
Disaggregating  One  Level 
Down  the  Attribute  Tree 

Tnese  sufficient  conditions  enable  us  to  draw  the 
oomination  digraph  of  Figure  2.  It  appears  that 
alternative  2  is  the  single  nondominant  digraph. 
However  small  changes  could  easily  result  in  al¬ 
ternative  3  becoming  (also)  nondominant.  Sc  we 
Sev  wish  to  ao  further  down  the  tree. 


(wlj,  wS,  and  w“)to  find  the  total  utility-  They 
were  b^sed  on  Snchcring  value  scores  at  0  and  1. 

We  can  change  these  scores  for  u? { )  to  the  interval 
0  -*■  1  by  use  of  y  *  ex  +  6  with  a  e  1.6949  and 
b  =  -.2559.  Then  we  get 


Alternative 

al 

a2 


a- 

0 


u“(a) 

.6034 

1.0 

.3729 

0 


Now,  perhaps  the  DM  suggests  the  same  weights  as 
before.  Then  we  can  calculate 


Suppose  that  the  decisionmaker  wishes  to 
prioritize  the  alternatives  and  so  elects  to  go 
further  down  the  tree.  We  have  shown  that,  except 
in  pathological  cases,  aggregating  up  the  tree 
strengthens  the  oarameter  specificity  order.  Thus 
disaggregating  cown  the  tree  might  seem  counter- 
P’-ocuctive.  jn  a  top  down  approach,  however,  we 
necessarily  may  have  little  confidence  in  initial 
weights  anc  utility  scores  elicited  at  the  top  of 
the  tree  but  ere  able  to  refine  these  to  have 
greater  precision  as  wo  move  down  the  tree. 

Ue  might,  for  example  disaggregate  the  compo¬ 
nents  cf  the  utility  uT(a)  to  get 


Alternate ve 

a. 

» 

a2 
C  - 


>-e  decisions 
W,:  =  C.5,  wt  =  C.2,  end  w:  =  C.3.  How  we  are  able 
I  c 

*.c  calculate  the  utility  score  at  attribute  u°. 

>'e  obtain 


ul(ai 

.6 

1 

.7 

C 


Attribute  Scores 

uZ^)  u|(«v) 

1  .2 

0  1 

.4  0 

.6  .3 


,er  rr.ic.ht  also  say  that 


Al ternetive 

B1 

a2 

c3 

a4 


ufe^ 

i> 

min 

max 

0.5148  w 

0.5612 

0.65  - 

0.767 

0.2955  - 

0.4305 

0.2033  - 

0.50 

Figure  3  -  Domination  Digraph 


and  can  now  select  the  two  best  altetnatives  as 
shown  in  the  domination  digraph  of  Figure  3. 


Next  the  DNi  perhaps  suggests  that  disaggre¬ 
gation  of  the  components  of  Uj(a)  is  desirable. 
Suppose  that  we  obtain 
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Alternative  uf(a.)  u]:(a.j) 


a2  0  0.1  -  0.4 

a,  0.3  0.5  -  0.8 

o 

c4  0.2  -*0.7  0 

c  c 

cse  gnat  we  unitiallv  obtain  >  3w^  and  we 
--r.al  agreement  that  0  <_  wj  <  0.25  and 
••  <  i.C.  These  are,  of  course  required 

;  inequality.  Next  we  calculate 


Alternative 


u3^ai ) 


a,  0.3  -  0.425 

a,  0.15  -  0.70 

ave  test  our  anchor  again.  We  might  wish  to 
Storm  the  maximum  value  such  that  1  remains  at 
c  tne  C.l  minimum  score  shifts  to  0.  We  use 
a>  *  6  with  a  *  1.111  end  b  »  -.1111  and  the 
e  attribute  score  matrix  becomes 

Alternative  u5(a) 


a,  .3  -.3511 

a4  .15  -  .667 

■  we  see  that  we  have  reduced  the  imprecision. 
.  “ore  tne  DM  is  asked  whether  or  not  it  is 
--tie  tc  cr.anoe  the  weights  w^.  Perhaps  the 
s'  <  no.  “her.,  we  can  calculate  the  scalar 


Alternative  rln  r,£x 
a^  C. 5148  -  0.5612 

c-  0.65  -‘0.767 

L 

c-  0.256  -  .AAA 

a;  0.2160  -  .AAA 

:a'-.ct  get  any  greeter  alternative  specificity 
*  this  expression  compered  tc  that  cf  Figure  2. 
sver.  we  a'e  now  ruen  more  confident  that  alter- 
' ve  two  is  better  than  one  which  is  better  then 
as  ar.c  four,  than  we  were  earlier  since  t^here  is 
'-Ch  mere  separation  between  U(a-)  anc  ’J(a^) 


than  previously  es_well  as  creater  separation 
between  u(a^)  and  Ufa,)  or  U(a4). 

Of  course  we  could  expand  the  attribute  tree 
still  farther  but  the  effort  thus  far  seems  to 
strongly  suggest  that  alternative  2  is  our  most  pre¬ 
ferred  alternative.  At  this  point  we  might  wish  to 
use  the  structure  that  we  have  elicited,  and  redo  the 
parametric  elicitation  effort  as  a  check  on  our 
approach.  We  would  use  Eqs.  (6)  and  (7)  which  yield 
necessary  and  sufficient  conditions  for  a^  }  a  . 

SUMMARY 

We  have  used  a  sensitivity  approach,  based  on 
parameter  imprecision  and  a  toe  down  approach,  to 
elicit  the  minimally  relevant  structure  for  an  at¬ 
tribute  tree  and  to  prioritize  a  set  of  alternatives. 
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ABSTRACT 

This  paper  first  discusses  the  use  of  the  pre¬ 
ference  relation  "selection  of  A  and  rejection  of  B  is 
.referable  to  selection  of  B  and  rejection  of  A." 
^:.is  contextual  relation  yields  descriptive  models  of 
rhoice  under  uncertainty  that  explain  many  observed 
violations  of  classical  single  attribute  utility 
theory.  It  is  shown  that  successful  use  of  this 
•  relation,  for  descriptive  purposes,  requires  careful 
attention  to  elicitation  of  realistic  decision  situa- 
~*tion  structural  models  and  information  observability 
conditions  within  this  model.  Reservations  with- 
respect  to  use  of  the  regret  model  for  normative 
purposes,  due  to  potential  nontransitivities  of  the 
contextual  relation,  are  discussed. 

.  1.  INTRODUCTION 

Tie.-*  is  much  eviletce  16,9,10,17-21]  available 
that  many  people  systematically  violate  the  tenets  of 
subjective  expected  utility  theory  in  actual ,  or 
descriptive,  choice  situations.  Many  human  informa¬ 
tion  processing  and  judgmental  flaws  could  be  cited. 
Among  the  many  detailed  studies  of  these  information 
•rrocessing  biases  and  flawed  cognitive  heuristics  that 
nay  lead  to  poor  judgment  with  reference  to  much 
contemporary  literature  are  1 10, 18-21],  Prospect 
•neory  (9,21 }  represents  perhaps  the  most  significant 
study  of  systematic  descriptive  violations  of  the 
normative  expected  utility  theory.  Our  purpose  in 
this  paper  is  to  discuss  the  recently  revived  interest 
.no  extensions  to  regret  theory  13-3.13]  especially  as 
'-they  relate  to  descriptive  and  normative  decision 
behavior.  We  are  especially  concerned  with  extensions 
of  regret  theory  to  incorporate  decision  situation 
■framing  and  information  availability  perspectives. 

3.  THE  FRAMING  OF  DECISION  SITUATIONS  AND 

ASSOCIATED  EFFECTS  ON  CHOICE 

Violations  of  consistency  and  coherence  in  choice 
rr.av  often  be  traced  to  cognitive  limitations  which 
govern  the  perceptions  of  decision  situations,  the 
rrocessing  of  information,  and  the  evaluation  of 
-options.  A  strong  determinant  of  the  frame  or  struc¬ 
ture  adopted  for  a  given  decision  is  the  decision- 
maker's  experiential  familiarity  with  the  issue  under 
ronsioeration.  Because  of  imperfections  in  human 
.cognition,  changes  of  perspective  often  reverse  the 
-relative  apparent  desirability  of  achieving  various 
bjecuves  and.  consequently,  the  relative  desirabil¬ 
ity  of  options  that  lead  to  objective  attainment. 
Similarly,  variations  in  the  framing  of  alternatives, 
contingencies,  and  outcomes  may  result  in  systematic 
•eversal  of  preferences.  The  order  in  which  infor¬ 
mation  is  presented  (primacy  or  recency  effects)  often 
-nduly  influences  ones  initial  estimate  (anchor)  of  a 
situation.  It  is  essential  that  problems  be  framed  m 
a  very  careful  fashion  sucb  that  mental  models,  or  any 
other  models  that  the  decisionmaker 
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may  choose  for  the  decision  situations,  are  truly 
representative  of  the  essential  features  of  the 
situation  at  band  in  order  to  avoid,  or  at  least 
minimize,  possibilities  for  cognitive  bias  that  may 
be  stimulated  by  an  "improper"  frame. 

Consider,  for  example,  the  decision  situation 
illustrated  in  Figure  1.  Alternative  B  should  be 
chosen  over  Alternative  A,  assuming  that  our  deci¬ 
sion  rule  is  to  select  the  alternative  with  the 
greatest  expected  return.  Generally,  the  value  of 
money  is  not  a  linear  function  of  the  amount  of 
money,  however,  due  to  the  satiation  effect.  Also 
we  have  an  attitude  toward  risk  that  further  shapes 
the  value  function  into  a  utility  function.  These 
separate  and  distinct  issues  of  preferences  and  risk 
aversion  will  be  discussed  later.  Further,  negative 
outcomes  are  valued  in  a  different  fashion  than 
positive  outcomes  of  the  same  amount.  Valt  func- 
tiocs  1  *  often  convex  fir  gains  and  concave  for 
losses  |9]. 

Let  us  now  examine  the  various  urn  represen¬ 
tations  shown  in  Figure  2  from  which  the  decision 
situation  graphically  illustrated  in  Figure  1  could 
have  been  obtained;  let  us  also  speculate  on  bow  the 
decisionmaker  might  react  in  each  case.  There  are 
four  choice  situations  illustrated.  In  each  case, 
the  decisionmaker  is  able  to  view  the  ball  drawn 
from  the  urn.  In  some  cases,  additional  information 
is  available. 

Suppose  that  we  must  choose  between  the  options 
described  in  choice  situation  1.  If  we  choose 
option  A  and  a  white  or  shaded  ball  is  drawn,  then 
we  obtain  nothing.  However,  it  does  not  appear  that 
we  would  feel  badly  about  not  having  chosen  option  B 
since,  in  this  latter  case,  we  would  surely  have 
lost  money.  We  might  well  feel  quite  good  at  choos¬ 
ing  opt.on  A  and  not  cbonsirg  urn  B.  Thus,  we  see 
that  the  value  felt  from  a  decision  outcome  may  be  a 
combination  of  value  for  what  we  did  obtain,  as  well 
as  regret  or  joy  for  what  we  could  have  obtained  bad 
we  chosen  the  other  optioD.  If  after  having  sel¬ 
ected  option  A,  a  black  ball  is  drawn,  we  might  or 
might  not  have  regret  associated  with  not  having 
selected  option  B  where  we  would  have  won  $500.  It 
is  possible  that  we  would  just  feel  good  about 
having  played  it  safe  and  won  $100.  Alternatively, 
there  could  be  regret  at  not  having  chosen  option  B. 
It  appears  that  many  people  would  express  post-deci¬ 
sion  regret  at  selecting  option  A  and  obtaining  a 
black  ball.  Therefore,  the  need  to  include  regret 
as  an  attribute  of  the  descriptive  choice  situation 
becomes  more  apparent. 

Suppose  that  we  choose  option  B.  If  a  white  or 
shaded  ball  is  drawn,  it  is  very  possible  that  we 
would  feel  badly  about  having  been  greedy  and  chosen 
option  B  over  the  safer  bet  of  selecting  option  A. 
Thus,  there  exists  regret  associated  with  this 
choice.  Here,  again,  one  experiences  post-oecision- 
al  regret.  If  a  black  ball  is  drawn,  we  would  be 
quite  bappy  with  having  selected  option  B  in  the 
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'  f  r  %  v.  ;\..tr  ^  - 1 .  sv  a  ivist-decision  effect, 

bins  cr  s.cneiv.  ti.it  is  mooified  from  the  pre-deci¬ 
sion  situai  'nn.  ion  nf  choice  situations  2,  3 

ind  -  show  that  these  are  not  at  all  equivalent,  even 
though  they  are  represented  by  the  same  decision  tic*. 

3.  THF.  kT.F.r,  FOR  AVAILABLE  1  NTOSttATI  OK  SENSITIVE 

THi.OF.lt S  OF  REGRET 

Sell  | ; - 2 )  was  perhaps  the  first  to  advocate  t nc 
inclusion  of  regret  as  a  sernnn  attribute  to  more 
fully  capture  the  decisionmaker's  values.  It  has 
often  been  suggested  that  regret  be  used  as  a  surro¬ 
gate  for  value  and  that  an  option  alternative  Si- 
selected  which  minimizes  regret.  But  regret,  in  the 
definitive  work  of  Bell,  is  measured  against  some 
ideal  best  and  worst  outcomes  and  these  same  anchors 
are  used  to  measure  regret  for  2II  outcomes.  Bell's 
effort,  ar.o  related  independently  obtained  results  due 
to  Loomes  and  Sugden  (13),  consider  value  and  regret 
as  simul taneous iv  present  attributes  of  decision 
outcomes.  Tvc-option  situations  are  considered  and 
regret  is  a  differential  concept  that  is  measured 
within  the  outcome  states  across  the  options  that 
could  have  led  to  these  states. 

This  method  appears  applicable  in  two  outcome 
win/lose  situations  where  the  selection  of  a  winner  in 
one  choice  would  result  in  post-decision  error-free 
identification  of  a  win  or  loss  situation  had  the 
other  option  been  selected.  There  are,  of  course, 
many  examples  of  decision  situations  where  one  may 
obtain,  post-decision,  full  knowledge  about  what  would 
have  ..appened  under  the  option  not  selected.  There 
•re,  however,  other  decision  situations  where  complete 
post-decision  knowledge  about  what  would  have  happened 
under  the  option  not  selected  is  not  available.  And 
there  are  many  decision  situations  which  involve  more 
than  two  alternative  courses  of  action.  This  effort 
extends  regret  theory  to  incorporate  these  considera¬ 
tions. 

Consider,  for  example,  the  problem  represented  in 
Figure  3  where  option  A  gives  SI, 000  with  probability 
0.9  and  SO  otherwise.  Option  E  gives  5750  for  sure. 
The  choice  of  option  B  over  lottery  A  may  be  attri¬ 
buted  to  a  certainty  effect;  we  prefer  a  certain  S750 
to  a  0.9  chance  of  winning  SI. 000  and  a  0.1  chance  of 
winning  SO.  In  the  full  information  framing  situa¬ 
tion,  the  decisionmaker  views  the  problem  as  shown  in 
Figure  7.  In  the  ordered  pair  (a,b),  the  first  attri¬ 
bute  "a”  represents  what  w»  actually  gam  or  lcse  and 
the  second  attribute  "b”  represents  the  assets  fore¬ 
gone  by  not  having  selected  the  other  alternative.  We 
assume  a  linear  multi-attribute  utility  function  form 
such  that  for  n  outcomes  of  a  decison  alternative  A., 
we  have 

ELIA)  =  2  p  (A)  |u.(A)  ♦  f4 (A) J .  (1) 

Here  p, (A)  is  the  probability1  of  obtaining  outcome  1 
giver,  that  option  A  is  selected.  u.(A)  is  the  utility 
associatec  v;th  obtaining  outcome  i  from  selection  of 
option  A.  f.fA)  is  the  regret  associated  with  obtain¬ 
ing  outcome  ‘i  from  option  A  and  not  obtaining  "some 
ether  outcome."  Clearly,  we  need  to  be  careful  in 
anchoring  this  other  outcome.  In  order  to  have  option 
S  preferred  to  option  A.  £  )  A,  we  must  have,  where  we 
let  u(lOCP)  =  1  and  u(0)  =  0, 

Pll  -  flH-C))  r  (l-p)f(-C)  <  u(C) 

-  pf(C-M)  t  ll-p)f(C) 

The  second  attribute  in  the  oroereo  pair  is 
referred  to  as  the  foregone  assets  unoer  the  total 
information  assur.rtien  since  it  is  just  the  outcome  in 
the  otr.er  lottery.  It  is  very  important  to  note  that 
-aloe  here  is  a  cardinal  value  function  measured  with 
some  presumed  anchor  w-hereas  regret  is  a  differential 
cardinal  measure  anchored  on  another  outcome  that 
could  have  been." 

This  procedure  suffices  for  the  special  case 
v.'.ere  the  problem  being  evaluated  may  be  represented 


by  the  cnu-urii,  two-outcome  full  mswrisatioq  model 
shown  in  Figure  A.  In  this  case,  if  one  wing  ^r- 
loses  after  having  selected  one  option,  then  it  c*a 
be  determined  whether  one  would  have  won  cr  lost  iud 
the  other  option  been  selected.  However,  suppose 
tits!  Figure  3  was  intended  to  be  representative  ef 
the  two  urr.  problem,  shown  in  Figure  5.  There  are 
only  two  cases  associated  with  the  model  of  Figure  5 
where  regret  enters  the  decision  situation  as  a 
second  attribute.  These  involve  option  A.  If  ve 
select  option  R  and  the  certain  return,  there  is  do 
way  of  knowing  whether  we  would  have  won  or  lost  had 
the  other  urn  been  selected. 

A  question  of  significant  interest  is  whether  or 
not  post  decision  knowledge  of  the  outcomes  increases 
or  decreases  the  overall  utility  of  Che  certain 
outcome  alternative  B.  The  utility  of  B,  with  no 
post -deci s ion  information  about  the  outcomes  obtained 
from  alternative  A  available,  is  u(C).  With  pott- 
decision  information  (regret)  available,  it  is 

EU(B)  =  u(C)  ♦  pf(C-H)  *  (l-p)f(C)  (3) 

The  answer  to  our  question  seemingly  lies  in  the 
regret  function.  Post-decision  outcome^  information 
increases  the  utility  of  alternative  B,  such  that 
B  )  B,  if 

pf(C-M)  ♦  (l-p)f(C)  <0  _  (4) 

and  decreases  the  utility  of  alternative  B,  such -that 
B  )  B.  if 

pf(C-M)  *  (l-p)f(C)  >  0  (5) 

The  alternatives  A  and  A  should  have  the  same  ex¬ 
pected  utility  hare  for  these  pairwise  preference 
comparison,  examples^  We  will  have  alternative  A 
preferred  to  B,  A  )  B,  if 

p|l  -  f(H-C))  ♦  O-p)f(-C)  >  u(C)  (6) 

where  we  lei  f (0)  =  0  for  convenience.  We  see  that 
there  will  exist  preferenre  reversals,  B  )  A  -  A  )  B, 
if  Eqns.  (2)  and  (6)  are  satisfied.  If  this  occurs, 
Eqn.  (5)  is  satisfied^  In  a  similar  way  we  obtain 
preference  reversals,  B  }  A  ~  A  )  B,  if  neither  Eqn. 
(2)  nor  Eqn.  (6)  is  satisfied.  If  this  occurs,  Eqn. 
(4)  is  satisfied.  Thus  we  see  that,  under  appropri¬ 
ate  circumstances,  we  can  obtain  preference  reversals 
by  changing  the  information  set  available  to  the 
decisionmaker.  In  most  cases  we  expect  that  greater 
post  decision  outcome  information  will  increase  the 
utility  of  the  uncertain  outcome  alternative,  assum¬ 
ing  it  is  favorable,  and  then  we  expect  Eqn.  (4)  to 
bold. 

An  interesting  modification  to  the  urn  model 
decision  situations  can  be  made  by  inserting  k  no-win 
vbite  balls  in  each  urn  for  the  decision  situations 
depicted  in  Figures  4  and  5.  We  preserve  the  regret 
that  is  associated  with  choice  situation  7  but  the 
certainty  regret  effect  associated  with  choice  situa¬ 
tion  8  seems  to  vanish.  There  is  now  no  certain  way 
of  knowing  what  would  have  occurred  under  outcome  B 
if  we  select  option  A.  Of  course,  if  k  is  small  we 
have  a  relatively  good  idea  of  what  would  occur,  but 
there  is  no  way  in  which  we  can  know  for  sure. 
Suppose,  for  example,  that  we  let  M  =  $1,000,  C  ~ 
S750,  m  =  45,  and  n  =  5.  It  seems  not  at  all  unrea¬ 
sonable  that  we  prefer  choice  A  to  choice  E  in  choice 
situation  7  and  6  A  in  choice  situation  fc.  This 
might  be  especially  the  case  if  we  represent  a  group, 
and  if  we  might  encounter  group  criticism  should  we 
select  an  option  that  yields  a  result  that  is  less 
than  that  which  is  known  to  have  been  obtained  under 
the  other  option. 

Now  suppose  we  add  k  =  950  white  balls  to  each 
urn.  We  then  obtain  the  decision  situation  struc¬ 
tural  models  of  Figure  6.  Our  preferences  should 
remain  the  same  regardless  of  k  if  we  assume  that 
conventional  utility  theory  is  fully  applicable.  The 
sure  thing  principal  of  Savage  and  the  strong  inde¬ 
pendence  axiom  of  Samuelson  each  require  this.  These 
early  seminal  results  in  decision  analysis  are  based 


< r.  the  -assumption  thst  pro-decision  and  post-decision 
«  regret  information  is  the  same. 

It  is  very  likely,  however,  that  we  will  prefer 
the  more  risky  options  A  and  A  since  there  is  a  33 « 
greater  return  with  only  slightly  greater  risk.  At 
first  glance,  this  might  appear  to  contradict  the 
results  that  follow  from  use  of  Eqn .  (6).  But  Eqn . 
(c)  is  formally  not  applicable  as  addition  of  the  k 
white  balls  to  the  urn  has  modified  the  information 
center.!  present.  Sow  we  no  longer  know  that  option  R 
will  produce  a  winner,  and  the  decision  situation 
model  is  now  tbat  of  figure  da  and  not  tbat  of  Figure 

The  significance  of  this  observation  is  tbat  a 
knowledge  of  information  patterns  in  tbe  decision 
situation  model  is  essential;  and  tbat  the  notion  of 
'regret"  is  not  at  all  independent  of  risk  levels, 
especially  when  there  are  post-decision  information 
uncertainties .  If  k  =  1 .  for  example,  it  is  quite 
obvious  that  the  regret  model  of  Figure  $  would  be 
more  applicable  than  that  of  Figure  5a.  However,  when 
there  is  full  post-decision  outcome  information,  then 
it  would  appear  that  regret  is  not  strongly  dependent 
upon  the  risks  involved.  With  k  =  950  such  tbat 
Figure  5b  results  for  the  full  post-decision  outcome 
information  case,  and  with  k  =  0  for  which  we  obtain 
Figure  A,  tbe  regret  terms  are  essentially  the  same. 

There  have  been  a  Dumber  of  attempts  to  illu¬ 
strate  tbe  nonrationality  of  choices  which  violate  one 
or  nor o  of  the  classic  a::,  ons  o*  decision  theory.  We 
shall  briefly  examine  a  simple  situation  which  is 
illustrative  of  these  here.  Our  purpose  in  doing  this 
is  to  demonstrate  the  need  to  carefully  construct 
decision  situation  structural  models,  especially  with 
respect  to  information  flow  patterns,  including  the 
nature  of  any  "regret”  that  is  associated  with  tbe 
decision  situation.  In  tbe  "full  information"  case 
illustrated  in  Figure  1  many  people_  will  prefer  B  = 
(C,lj  to  A  =  (M.P)  but  will  prefer  A  =  (M,ap)  to  B  - 
(C.a),  where  M  >  C  and  0  <  a,  p  <  1.  There  are  at 
least  two  decision  matrices  which  may  be  claimed  to 
describe  this  decision  outcome  situation: 

(a)  __  Probability  of  Outcome 

Cation  a*p  apO  -a )  (l-ap)a 

AM  MO 

B  C  0  C 

(b)  Probability  of  Outcome 

Option  ag  a ( 1  -p)  1 -a 

AM  0  0 

E  C  C  0  . 

Ir.  each  of  tbe  above  matrices  we  have  A  =  A  (a  =  0) 
ar.o  E  =  E  (a  =  0).  The  question  which  immediately 
arises  is:  what  does  "full  information"  infer  here? 
Trie  answer  is  that  there  is  no  answer  to  the  question 
as  posed.  V>e  simply  must  know  about  the  decision 
situation  structural  model  or  frame  used  to  represent 
'•r.e  task  at  banc.  We  may  represent  these  two  "full 
ir.fcrrr.ation''  decision  situations  by  the  urn  models  and 
ctcision  trees  of  Figure  7.  If  we  view  value  and 
regret  as  the  components  of  utility,  the  decision 
criteria  for  tnest  two  frames  are  quite  different  and 
;:ven  bv  A  ^  E  iff 

;  -  v ( c )  a  aplf(M-C)  -  f(C-M)]  *  p(l-a)|f(K) 

-  f(-fl))  *  (I-ap)if(-C)  -  f  (C ) )  >  0 
icr  the  situation  model  of  case  (a)  and 

P  -  v(c)  a  p|f(M-C)  -  f(C-M)]  a  (3-p)|f(-C) 

*  f (C)  ]  >  0 

for  tbe  situation  model  of  case  (b).  It  is  this 
ratter  situation  model  that  we  have  considered  in  our 
previous  discussions.  For  tbe _ situation  model  of 
Figure  7(b)  we  go  from  options  A  and  B  to  options  A 


and  B  by  changing  a  from  some  small  number  (typi¬ 
cally)  to  1.  This  simply  means  tbat  we  remove  shaded 
balls  from  the  urn.  In  eacfc  case,  we  obtain  the 
standard  utility  expressions  if  we  remove  the  regret 
terms.  Also,  the  certainty  effect  is  absent  in  the 
model  of  Figure  7(b). 

By  no  means  does  this  discussion  suggest  that 
the  situation  model  of  Figure  7(b)  is  more  realistic 
than  that  of  Figure  7(a).  A  judgment  of  this  sort 
must  necessarily  depend  upon  tbe  task  at  hand.  If  we 
consider  the  specific  situation  where  C  =  $5,000,  M  = 
$4,500,  p  =  0.98  and  a  =  0.05  then  changing  a  to  1 
results  in  quite  different  frames  of  the  decision 
situation  as  indicated  in  Figure  10,  which  is  com¬ 
puted  with  n  =  1000.  To  use  either  of  these  models 
requires  some  illustration  of  tbe  physical  situation 
involved ! 

Thus,  it  is  not  fully  meaningful  to  speak  of 
value  and  regret  associated  with  prospects  A  =  (M,p) 
and  E  =  (C,J).  There  is  no  formal  difficulty  in 

using  the  value  concept  since  it  is  presumably  an¬ 
chored  on  some  ideal  best  and  ideal  worst  possibil¬ 
ities.  But  the  regret  concept  is  based  upon  oppor¬ 
tunity  foregone  by  not  selecting  the  other  option  and 
the  question  immediately  arises  concerning  available 
information  about  what  we  would  have  obtained  under 
the  option  not  selected.  The  conclusion  that  we  must 
exercize  considerable  care  in  obtaining  the  decision 
situation  structural  model  is  inescapable. 

4.  THE  POTENTIAL  FOR  NONTRANSITIVE  BEHAVIOR 

USING  PAIRWISE  REGRET  COMPARISONS 

It  is  well  known  that  sets  of  pairwise  pre¬ 
ference  comparisons  are  often  nontransitive.  This 
may  well  occur  using  tbe  regret  concepts  presented 
here  since  the  regret  associated  with  selecting  an 
alternative  must  necessarily  be  associated  with  the 
alternative  not  selected.  Thus,  it  is  not  meaningful 
to  speak  of  the  expected  utility  of  alternative  A 
when  regret  associated  with  not  selecting  alternative 
B  is  involved.  We  could  use 
N 

EU(A,B)  =  l  p  (A)  | u . (A)  *  f  (A,B)) 
i  =  ) 

where  the  u  (A)  are  the,  perhaps  mul^i-attributed , 
components  of  the  utility  of  the  i  outcome  of 
option  A:  the  f.(A,B)  are  the  regrets,  which  are 
negative  for  true*  regret  and  pgjjitive  for  rejoicing, 
associated  with  obtaining  the  i  outcome  from  alter¬ 
native  A  rather  than  the  possibly  known  outcome  asso¬ 
ciated  with  rejecting  alternative  B;  and  the  p.(A) 
a  ;•£  the  probabilities  associated  with  obtaining  Jthe 
i1,  outcome  slate  following  choice  of  alternative  A. 
It  is  very  convenient  but  not  strictly  necessary  that 
this  probability  be  the  same  across  the  N  outcome 
states  for  options  A  and  E.  We  will  say  that  A  )  B 
iff  EU(A,B)  >  EU(E,A).  From  this,  we  easily  see  that 
there  is  no  reason  to  infer  that  if  A  J  B  and  B  ^  C, 
we  must  necessarily  have  A ^  C.  Figure  8  illustrates 
a  three-choice  situation  with  preference  intransi- 
tivities  that  occur  because  of  the  different  informa¬ 
tion  sets  available  ir.  the  three  pairwise  preference 
comparisons.  This  would  suggest  much  caution  in  the 
use  of  any  prioritization  approach  that  is  based  on 
pairwise  preference  comparisons  and  assumed,  but 
nonvenfied,  transitivity  among  preference  relations 
as  it  becomes  extraordinarily  easy  to  produce  agenda 
dependent  results. 

5.  CONCLUSIONS  AND  SUMMARY 

In  this  paper,  we  have  examined  the  recently 
introduced  concept  of  pairwise  comparison  regret.  As 
expected,  tbe  regret  concept  does  not  necessarily 
lead  to  transitive  preference  comparisons.  We  have 
demonstrated  the  strong  need  to  incorporate  decision 
process  descriptions  m  framing  of  regret  situations. 
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Scwra:  ; 1 lustrat ive  examples  indicate  that  the  fram¬ 
ing  c!  decision  output  states  and  the  information 
%  available  concerning  the  outputs,  resulting  from 
aecision  options  not  selected,  greatly  influences  the 
regret  calculations.  The  central  conclusion  from  this 
is  that  careful  decision  situation  structuring  must  be 
associated  with  the  regret  concept  if  the  results 
obtained  are  to  have  descriptive  value. 

Even  more  interesting  and  potentially  useful 
questions  concern  the  value  of  the  regret  concept  in  a 
normative  sense.  Clearly,  many  people  experience 
notions  of  regret  and  hesitate  rejecting  alternatives 
because  of  some  desirable  properties  of  the  rejected 
alternatives  that  will  then  be  foregone.  We  roust  be 
careful  however  to  note  that  the  "preference"  relation 
implied,  through  use  of  regret,  by  A  )  B  is  not  just 
"A  lis  preferred  to  B"  but  "selecting  A  and  rejecting  B 
is  preferable  to  selecting  B  and  rejecting  A."  Thus 
the  two  preference  relations  A  ^  £  and  B  )  C  do  not 
provide  sufficient  information  to  infer  A  )  C.  The 
contextual  relation  is  not  uniquely  defined  here, 
it  should  really  be  written  to  infer  the  true  contex- 
luality  of  the  situation  at  hand.  What  we  have  really 
shown  is  that  A  )  B  and  B  )  C  say  about  )  It 

AB  BC  AC 

might  well  be  a  serious  mistake  to  use  approaches 
wmch  infer  that  it  does  if  we  allow  for  pairwise 
comparisons  of  this  sort. 

We  agree,  strongly,  with  the  comment  of  Kahneman 
and  Tverskv  |9]  that  those  departures  from  subjective 
exnec'ed  utility  theory  that  prospect  theory  (and 
regret  theory)  described  are  such  that  they  "roust  lead 
to  norroatively  unacceptable  consequences.'*  A  well 
conceived  decision  support  process  should  assist  the 
oecisionmaker  in  realizing  the  potential  errors  in¬ 
volved.  For  these  reasons,  among  others,  we  strongly 
encourage  elicitation  processes  that  encourage  com¬ 
parison  within  attributes  and  across  outcome  states 
for  alternatives.  It  would  seem  that  pairwise  prefer¬ 
ence  comparison  of  alternatives  is  fraught  with  diffi¬ 
culties  and,  unless  great  caie  is  exercized,  can  lead 
tc  potentially  misleading  results.  At  the  very  least, 
ve  must  be  fully  aware  of  the  detailed  potentially 
context  dependent  definition  of  the  pairwise  relation, 
)  ,  and  that  this  relation  is  strictly  speaking,  in¬ 
comparable  in  the  expressions  A  )  B  and  6  )  C 

AB  BC 

when  these  expressions  imply  pairwise  comparison  with 
nc  ioei.1  alternatives  tc  serve  as  a  reference  point, 
anchor,  or  basis  for  the  comparison.  In  other  words, 
we  must  be  careful  to  insure  that  the  relation  }  is 
defined  in  a  fashion  such  that  it  is  context  indepen- 
cer.t  across  alternatives  if  we  are  to  use  it  in  the 
tanner  indicated  bere. 

This  cannot,  however,  be  used  as  an  invocation 
against  using  the  regret  concept,  or  the  more  general 
prospect  theory,  to  describe  behavior.  For  descrip¬ 
tive  purposes  these  approaches  have  much  to  recommend 
mem.  Understanding  of  descriptive  reality  is  a 
necessary  first  step  towards  a  meaningful  normative 
process.  In  this  sense,  among  others,  these  ap¬ 
proaches  have  considerable  value.  And,  of  course,  it 
r.ay  well  turn  out  that  the  regret  approach,  with 
suitable  lr.fcnr.aticn  framing,  will  not  lead  to  pre¬ 
ference  intrar.sitivities .  In  this  case,  assuming 
validity  of  the  value  and  regret  elicitations  |6,12), 
me  approach  would  seem  tc  have  much  potential  norma¬ 
tive,  as  veil  as  oescriptive,  appeal. 

A  number  of  extensions  to  our  efforts  suggest 
themselves .  Two  that  seem  particularly  cogent  concern 
examination  of  regret  elicitation  approaches  and  a 
closer  comparison  contrast  and  integration  of  the 
regret  concept  with  prospect  theory  17,9,21) ,  other 
axiomatic  approaches  114-16],  and  the  recently  intro- 
cuced  verv  promising  concept  of  relative  risk  aversion 
'4,11). 
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IMPRECISE  IMPORTANCE  WEIGHT  ASSESSMENT  FOR 
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We  present  a  procedure  for  Importance  weight 
assessment  for  a  single  stage  decisionmaking 
model  under  uncertainty  that  allows  imprecision 
in  the  utility  values  and  in  the  Importance 
weights.  An  assessment  approach  for  dealing 
with  nonunique  best  and/or  worst  alternatives 
for  a  given  attribute  is  suggested.  An 
example  illustrates  the  procedure  and  how  the 
procedure  could  be  implemented  using  currently 
existing  software. 


INTRODUCTION 

A  decisionmaker  may  not  be  able  and/or 
willing  to  provide  information  necessary  to 
precisely  identify  his  or  her  preferences, 
expressed  in  terms  of  a  utility  function.  In 
order  to  deal  with  this  possibility  and  with  the 
possibility  that  probabilities  also  may  be 
imprecisely  known.  Sarin  (1977a,  1977b), 

Fishbum  (1965),  White  and  Sage  (1980),  and 
White.et  al.  (1982a,  1982b)  have  developed 
procedures  for  alternative  evaluation,  prioriti¬ 
zation,  and  ranking  based  on  imprecisely  known 
parameter  values  (e.g.,  probability.  Importance 
weight,  lowest  level  utility  scores)  for  single 
stage  decisionmaking  models. 

In  this  paper  we  present  a  procedure  for 
enhancing  the  assessment  of  possibly  imprecise 
importance  weight  Information  for  the  case  where 
lowest  level  utility  scores  in  a  multilevel 
objective  hierarchy  may  be  imprecise  and  where 
probabilities  are  precisely  known.  We  also 
indicate  how  currently  available  software,  which 
has  been  named  ARIADNE  for  Alternative  Ranking 
Interactive  Aid  based  on  OomlNance  Information 
Fllcitation,  can  be  used  to  provide  information 
useful  for  this  assessment.  The  problem 
considered  is  formulated  in  Section  2,  and  the 
assessment  procedure  is  described  in  Section  3. 
An  illustrative  examole  is  presented  in  Section 
4.  Conclusions  are  given  in  the  final  section. 


PROBLEM  FORMULATION: 

We  now  present  a  normatively  based  and 
behaviorally  relevant  model  of  single-stage 
decisionmaking  under  uncertainty.  Let  A  be  the 
number  of  available  alternatives.  Once  an 
alternative  is  selected,  one  of  C  consequences 
will  occur.  If  alternative  a  is  selected,  then 
consequence  c  will  occur  with  probability  p,(a). 
If  alternative  a  is  selected  and  consequence  c 
occurs,  then  a  utility  of  u^c(a)  is  accrued  with 
respect  to  attribute  i ,  1  -  T,...,I.  We  assume 
that  the  attributes  are  additive  Independent 
(Keeney  and  Raiffa,  1976;  p.  295).  Thus  the 
expected  utility  of  alternative  a  can  be 
expressed  as 


Ip,  I  u1r(a)P  (a)  *  pu(a)p (a), 

1=1  'c=l  1c  c 

where  pj>0  is  the  importance  weight  associated 
I 

with  attribute  1,7  p.  =  1 ,  max(u.  (a):  for  all  a 
1=1  1  1C 

and  c)  =  1,  and  min{u<c(a):  for  all  a  and  c)  *  0. 

Assume  that  all  of  the  probabilities  pc(a) 
are  known  precisely,  u^  •  (uj c( a ) :  for  all  a  and 
c)  is  known  to  be  a  member  of  the  set  U^,i»l,..., 

I,  and  p  =  (o^,  for  all  i)  is  known  to  be  a 
member  of  the  set  P.  Let  R  be  the  relation  on  the 
alternatives  defined  as  follows:  (a'.a)eR  if  and 
only  if  the  expected  utility  of  alternative  a'  is 
at  least  as  great  as  the  expected  utility  of 
alternative  a  for  all  possible  values  of 
uj,i=l,...,I,  and  p.  Thus,  (a',a)eR  if  and  onlyif 

min  p[u(a')p(a')-u(a)p(a)]  (1) 

is  nonnegative,  where  the  minimum  is  with  respect 
to  all  UjeUj,i=l,.,.,I,  and  oeP.  It  is  shown  in 
White,  et  al.  (1982)  that  the  determination  of  (1) 
can  be  computed  by  the  following  two- level  set  of 
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linear  programs  when  U,,1al,...I,  and  P  are 
polyhedra: 

min  L P.v,(a*,a) 
peP  1  1  1 

where 

v^a'.a)  =  min  J!c[uic(a' )Pc(a' )-u1c(a)pc(a)]. 


Note  that  complete  determination  of  R  can 
require  the  solution  of  A  (A-l)  and  A  (A-l)I 
linear  programs,  respectively.  Use  of  the  easily 
proved  fact  that  R  Is  transitive  may  possibly 
reduce  the  number  of  linear  programs  required  to 
determine  R.  We  remark  that  the  forms  of  the  U^ 
and  P  may  indicate  that  there  exists  simplified 
procedures  for  solving  the  above  linear  programs. 
Simplified  procedures,  e.g.  procedures  for 
solving  linear  programs  with  bounded  variables 
(Bradley  et  al.,  1977,  p.  78),  may  be  of  con¬ 
siderable  Importance  if  quick  response  is 
necessary  and/or  a  small  computer  environment 
Is  required. 

Oetermi nation  of  the  v^(a',a)  may  require 
the  solution  of  a  mixed  integer  program  if  the 
best  and/or  worst  altemati ve/consequence  pairs 
with  respect  to  an  attribute  are  not  uniquely 
Identifiable.  To  illustrate  this  fact,  assume 
C*1  (decisionmaking  under  certainty),  A»5, 

0<u ( a ) <_!  for  all  a,  and 

u(l)  =  1  and/or  u(2)  *  1 

u(4)<u(3)<u(l ) 
u(5)<u(3)<u(2) 

u{4)  *  0  and/or  u(5)  *  0. 

Such  inequalities  perhaps  Indicate  an  ordinal 
ranking  of  the  alternatives  where  alternatives  1 
and  2  are  ranked  "good",  alternative  3  Is  ranked 
"fair"  and  alternatives  4  and  5  are  ranked  "poor". 
Note  that  our  model  insures  that  maxa(u(a)}=l  and 
mina(u(a))=0,  a  common  convention  (see  Keeney  and 
Raiffa,  1976,  p.  119  and  231).  The  above 
inequalities  would  then  have  the  following 
Interpretati  on: 

1>u(l)>l-d, 

1>u(2)>1-62 

u(l):>u(3hu(4) 

u(2)>u(3)hi(5) 

a^>u(5)5T) 

0<64+(5j<1 

5|C{0,1 >,  i*l ,2,4,5. 


We  will  observe  shortly  that  if  for  a  given  attri¬ 
bute  the  best  and  worst  alternatives  are  not 
uniquely  Identified,  then  importance  weight  assess¬ 
ment  can  become  complicated,  sometimes  significant¬ 
ly.  Thus,  in  most  circumstances  it  will  be  bene¬ 
ficial  to  refine  knowledge  of  the  utility  functions 
through  further  assessment  and/or  to  possibly 
restructure  various  portions  of  the  decisionmaking 
problem  In  order  to  avoid  as  much  as  possible, 
assessment  difficulties  associated  with  nonunique 
best  and/or  worst  alternatives  for  a  given 
attribute.  Although  the  utility  functions  assessed 
at  the  terminal  branches  of  the  objectives 
hierarchy  may  uniquely  identify  best  and  worst 
alternatives  for  each  attribute,  higher  level 
importance  weight  assessment  may  still  Involve 
nonunique  best  and/or  worst  alternatives.  This 
fact  will  be  Illustrated  by  the  example  presented 
in  Section  4. 

ASSESSMENT  OF  P: 

We  will  assume  that  constraints  on  the 
u.|»{ufC(a),  for  all  a  and  c)  are  known.  These 
constraints  might  be  based  on  assessment  proce¬ 
dures  discussed,  for  example,  in  Farquhar  (1982, 
p.  22)  and/or  the  binary  variable  description  just 
presented. 

Assessment  of  the  Importance  weights  are 
typically  based  on  Information  contained  in  (1)  the 
utilities  for  each  attribute  and  (2)  an  objectives 
hierarchy.  An  objectives  hierarchy  is  a  graphical 
depiction  of  the  functional  relationship  of  the 
objectives.  For  example,  consider  the  objectives 
hierarchy  in  Figure  1.  If  p.  and  p«  are  associated 
with 


w2*w2  =  ^ 
W'+Wj  =  1 


w"+w4  *  1 
°l+p2+p3+p4  =  1 

FIGURE  1:  An  Example  of  an  Objectives  Hierarchy. 

initial  cost  and  maintenance  cost,  respectively, 
then  w1  would  be  associated  with  a  notion  of  cost, 
say  overall  cost,  that  represents  a  combination  of 
initial  cost  and  maintenance  cost. 

We  remark  that  importance  weights  can  assume 
two  basic  forms  which  we  will  call  the  o  form  and 


the  w  form.  These  forms  are  Illustrated  In  Figure 
1  for  the  objectives  hierarchy  presented  there. 
Note  that  p-  Is  the  Importance  weight  for  the  itn 
terminal  attribute.  The  w  form  of  importance 
weights  assumes  that  the  Importance  weights  are 
normalized  at  each  level  of  the  objectives  hier¬ 
archy,  as  indicated  in  Figure  1.  The  relationship 
between  the  p  and  w  forms  is  straightforward  to 
determine.  For  example,  for  the  objectives  hier¬ 
archy  depicted  in  Figure  1, 

W1  *  p1^°3+p2^  ’ 

w'  *  (p1+P2)/(pj+P2+P3) 

w3  =  p3/(Pl+p2+P3) 

w"  -  p3  +  p2+p3 
w4  3  p4 

p^  *  w^'w"  ,  1»1,2, 

p3  *  w3w“ 

p4  *  w4  . 

Note  that 

W1  wj  *  p1/pj  ’ 
w'  w3  *  (p7+p2)/p3 

w"lw4  *  (P1+P2+P3)/P4 
Also,  observe  that 

Wj<b  P1ib(o1+p2)  ,  1*1,2, 

w'<b  p1+p2<b(p1+p2+p3) 

Wjsb  p^blo^pg  +  p3) 

w“<b  p^ +p2+pj<b 

4 

w  <b  p^b  . 

Thus,  assessment  in  terms  of  the  w  form  can  easily 
be  described  in  terms  of  the  p  form.  Description 
of  the  importance  weights  in  the  p  form  is 
preferred  from  a  computational  perspective  because 
it  is  most  directly  applicable  to  the  afore¬ 
mentioned  linear  and/or  mixed  integer  programming 
procedures.  However,  it  is  often  useful  to  use 
the  w  form  for  assessment. 

A  standard  approach  for  precise  assessment 
of  the  importance  weights  when  no  uncertainty 
exists  and  when  the  u,(a)  (since  the  consequence 
is  certain,  it  is  without  loss  of  generality  that 
we  drop  the  dependence  of  u.  (a)  on  c)  are  known 
precisely  is  as  follows.  Fir  each  i,  identify  the 
most  and  least  preferred^  lternatives,  a*  and  a.», 
respectively;  thus,  u,(a,)=l  and  u,(aj,)'o,  for1 
all  i.  4The  importance  of  u.(a?)-u!(a! J  relative 
to  u.(a  . ) -u i { a ..)  then  reprAsertts  the  relative 
value  or  ,',JtoJ.-.  (or  of  w.  to  w.,  if  it  is  pre¬ 
ferred  to  deal  with  the  w  form  of  importance 


weights).  For  example,  again  referring  to  Figure 
1,  assume  p,  and  p-  are  associated  with  initial 
cost  and  maintenance  cost,  respectively.  If  the 
difference  between  best  and  worst  initial  costs  is 
considered  to  be  twice  as  important  as  the  differ¬ 
ence  between  best  and  worst  maintenance  costs, 
then  p.  =  2p-  and  hence  w,*2/3  and  w?=l/3.  Due  to 
the  additlve^form  of  the  utility  function,  we  can 
then  determine  the  utility  values  for  the  attri¬ 
bute  "overall  cost"  by  calculating  u(a)*w.u. (a)+ 
w-u7(a).  We  have  thus  "moved  up"  the  hierarchy. 
Tne  best  and  worst  alternatives  with  respect  to 
“overall  cost"  and  attribute  3,  whatever  it  might 
represent,  can  then  be  combined  to  produce 
utility  scores  for  the  upper  level  attribute 
associated  with  w".  Once  w“  and  w.  are  assessed, 
a  total  order  on  the  alternatives  can  be  deter¬ 
mined  and  the  most  preferred  alternative  identi¬ 
fied. 

We  now  present  a  generalization  of  the  above 
importance  weight  assessment  procedure  that 
allows  utility  function  and  importance  weight 
imprecision.  Let  S?  (S,„)  be  the  set  of  all 
possible  most  (least)  preferred  alternative/ 
consequence  pairs  with  respect  to  attribute  i. 
These  sets  can  be  obtained  directly  from  the 
assessed  (u.  (a),  for  all  a  and  c}.  Assume  that 
we  wish  to  assess  the  relationship  between  w{  and 
w-,  i=j,  where  i  and/or  j  may  be  other  thaj 
lowest  level  objectives.  Select  (aT.cJeS. , 
(a.^.e.JeS.^a^OeSj,  (a,*,^  Je$.,.  OA  the 
assumption  that  faf.cp  ((af*,cf„))  is  the  most 
(least)  preferred  Alternative/cAnsequence  gair 
with  respect  to  attribute  1  and  that  (at.cj 
( (a )  is  the  most  (least)  preferred  Alter¬ 
native/consequence  pair  with  respect  to  attribute 
j,  we  assess  bounds  on  the  ratio  w./w., 
a<w./w.<8.  Assume  such  bounds  are'assessed  foj 
each  possible  combination  of  pairs  in  ST,S.*,S., 
and  S,*.  Let  a4  (6*)  be  the  lowest  such  liwer1 
(largest  such  upper)  bound  on  w./w..  We  then 
assume  that  a  <w./w.<6*.  Let  attributes  i  and  j  be 
the  lower  leveT  Attributes  associated  with  the 
higher  level  attribute  k.  Then, 


ukc(a)  =  wiu1c^+wjujc(a) ’  Vwj  *  ’• 


where  uic(a)  has  been  normalized  as  follows: 

V(a)  3  ^ic^^ic^^lc^* 


u,„  (a)] 


ic 


with  Uj£a)  analogously  defined. 
AN  ILLUSTRATIVE  EXAMPLE: 


We  now  present  an  example  to  illustrate  the 
above  assessment  procedure.  We  will  also  describe 
how  currently  available  software,  ARIADNE,  can  be 
used  to  solve  this  example.  For  simplicity, 
assume  C=l,i.e.  the  decisionmaking  under  certainty 
case.  Let  the  uf(a)  satisfy: 

Uj(l)*0,  Uj(2)*l ,  O.SiUjUKO.S,  0.21u1(4)10.3 


u2(1)*0,u2(2)=1,  0,2<u2(3)4).5,  0<u2(4)<0.4 
0.3<Uj(1)<1,  0.8<u3(2)<^1,  U2(3)*l,  u3(4)*0 
U4(1)-1,0.7<u4(2)<0.75,  u4(3)=0,  0.4<u4(4)<0. 75. 


utility  score  Information  and  the  following  Impor¬ 
tance  weight  Information:  0.95<p.j/p2<1.05, 
10pj<pj+p2,  and  lOp^^Pj+Pj. 

CONCLUSIONS: 


On  the  basis  of  this  Information  and  no  Importance 
weight  Information,  R  =  4>,1.e.none  of  the  alter¬ 
natives  Is  preferred  to  any  of  the  other  alterna¬ 
tives.  This  fact  can  be  determined  using  ARIADNE 
by  Introducing  the  above  equalities  and 
Inequalities  on  the  u,(a).  Vie  remark  that  ARIADNE 
can  also  consider  bounds  on  ratios  of  the  utility 
scores  as  long  as  comparison  Is  not  made  across 
attributes;  e.g.,  b*^  (aJ/Uj  ,{a')<b*. 


Let  Figure  1  represent  the  objectives 
hierarchy  for  this  example.  Clearly,  ST  *  {2}  and 
S.„  =  { 1 }  for  1=1,2.  Assume  an  assessment  pro¬ 
vides  0.95<w./w2<1.05,  or  equivalently, 
0.95<p,/p-£l  1 05.  This  information  does  not 
affect  R^hence  R  remains  null.  Ue  can  use 
ARIAONE  to  determine  this  fact  by  allowing  it  to 
consider  in  addition  to  the  utility  scores  the 
following  Importance  weight  Information: 
0.95£pj/p2£l.05. 


Let  u'(a)  =  w.u.(a)+w2u2(a),  the  utility 
function  associated  with  w'f  £It  is  easily  shown 
that  u,(l)=0,u'(2)=l,  0.2487<u'(3)<0.5,  and 
0.0974<u‘(4)<0.3513.  Ue  note  that  S  =  {2}, 


S!  =  {!},  S,  =  {3},  and  S,*  =  {4}.  ARIADNE  can  be 
*  J  * 
used  to  provide  S  and  (S3  and  53*)  by 


letting  it  consider  In  addition  to  the  utility 
score  information,  the  following  importance 
weight  information:  0.95<o.|/p2<1.05, 
P3=p4»Ps=0(p3=l).  Assume  ait  assessment  provides 

10wj<w',  or  equivalently  10pj<p^+p2.  Analysis 

then  Indicates  that  R={(2,3)},i.e.  alternative  2 
Is  at  least  as  preferred  as  alternative  3. 

ARIADNE  can  be  used  to  determine  this  alternative 
relation,  given  as  input  the  utility  score  infor¬ 
mation  and  the  following  importance  weight  infor¬ 
mation:  0.95<p,/p_<l .05  and 
alternative  l7  *,  Or  4  may  be 


10p3£  .+p2.  Thus, 
the  most£preferred. 


If  the  above  alternative  ranking  Information 
Is  not  sufficient  for  alternative  selection,  we 
consider  the  utility  function  u"(a)  »  w'u'(a)+ 
w.u.(a),  which  is  associated  with  the  importance 
weight  w".  Calculations  show  that  0<u(l)<0.0909, 
0.9818<u“(2)<1,  0.2487<u"(3)<0. 5455,  and 
0.0885<u"(4)<0.3513.  Thus,  S*  =  (2),  s"  =  {1.4}, 

sT  =  {1},  and  S..  =  {3}.  We  can  use  ARIADNE  to 
determine  S  and  S,  (S4  and  S4J  by  providing 

ARIAONE  with  the  utility  score  information  and  the 
following  importance  weight  information: 
0.95<O]/o2<l .05,  10r>j<Oj+n2,  and  p4=0  (p4=I). 

Suppose  an  assessment  provides  10w4£w",  or 
equivalently  lOo^Oj+t^+Pj.  Then,  R  *  {(2,3), 

(2,4),  (3,1)}  and  thus  alternative  2  is  the  most 
preferred  alternative.  Ue  determine  this  informa¬ 
tion  using  ARIADNE  by  providing  as  input  the 


In  this  paper,  we  have  presented  a  procedure 
for  Importance  weight  assessment  which  allows 
Imprecision  in  the  utility  values  and  In  the 
Importance  weights.  We  have  noted  that  a  charac¬ 
teristic  of  this  procedure  is  that  best  and/or 
worst  alternatives  for  a  given  attribute  may  be 
nonunique.  An  assessment  approach  for  dealing  with 
this  characteristic  was  suggested.  An  example  was 
used  to  illustrate  the  procedure  and  how  the  pro¬ 
cedure  could  be  implemented  using  a  currently 
existing  software  system,  ARIADNE.  Of  course, 
assessment  of  importance  weights  given  precise 
utility  scores  does  not  necessarily  have  to 
Involve  best  and  worst  alternatives  for  each 
attribute.  Other  approaches  to  importance  weight 
assessment  given  Imprecise  utility  scores  are 
under  development. 
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I.  INTRODUCTION 

THERE  IS  much  evidence  [6],  [9],  [10],  [17]-[21]  avail¬ 
able  that  many  people  systematically  violate  the  tenets 
of  subjective  expected  utility  theory  in  actual,  or  descrip¬ 
tive,  choice  situations.  Many  human  information  process¬ 
ing  and  judgmental  flaws  could  be  cited.  Among  the  many 
detailed  studies  of  these  information  processing  biases  and 
flawed  cognitive  heuristics  that  may  lead  to  poor  judgment 
with  reference  to  much  contemporary  literature  are  [10], 
[  18]— [21].  Prospect  theory  [9],  [21]  represents  perhaps  the 
most  significant  study  of  systematic  descriptive  violations 
of  the  normative  expected  utility  theory.  Our  purpose  in 
this  paper  is  to  discuss  the  recently  revived  interest  and 
extensions  to  regret  theory  [  1  ]— [3],  [13]  especially  as  they 
relate  to  descriptive  and  normative  decision  behavior.  We 
are  especially  concerned  with  extensions  of  regret  theory  to 
incorporate  decision  situation  framing  and  information 
availability  perspectives. 
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We  will  first  discuss  the  framing  of  decision  situations. 
Next,  we  will  incorporate  notions  of  decision  situation 
framing  within  regret  theory,  as  it  now  exists.  We  will  be 
especially  concerned  with  information  availability.  A  dis¬ 
cussion  of  potentially  nontransitive  behavior  [S]  that  may 
result  from  the  use  of  the  pairwise  comparisons  implied  by 
regret  theory  is  followed  by  our  conclusions  and  sugges¬ 
tions  for  extensions  of  this  effort. 

II.  The  Framing  of  Decision  Situations  and 
Associated  Effects  on  Choice 

Violations  of  consistency  and  coherence  in  choice  may 
often  be  traced  to  cognitive  limitations  which  govern  the 
perceptions  of  decision  situations,  the  processing  of  infor¬ 
mation,  and  the  evaluation  of  options.  A  strong  determi¬ 
nant  of  the  frame  or  structure  adopted  for  a  given  decision 
is  the  decisionmaker’s  experiential  familiarity  with  the  issue 
under  consideration.  Because  of  imperfections  in  human 
cognition,  changes  of  perspective  often  reverse  the  relative 
apparent  desirability  of  achieving  various  objectives  and, 
consequently,  the  relative  desirability  of  options  that  lead 
to  objective  attainment.  Similarly,  variations  in  the  framing 
of  alternatives,  contingencies,  and  outcomes  may  result  in 
systematic  reversal  of  preferences.  The  order  in  which 
information  is  presented  (primacy  or  recency  effects)  often 
unduly  influences  ones  initial  estimate  (anchor)  of  a  situa¬ 
tion.  It  is  essential  that  problems  be  framed  in  a  very 
careful  fashion  such  that  mental  models,  or  any  other 
models  that  the  decisionmaker  may  choose  for  the  decision 
situations,  are  truly  representative  of  the  essential  features 
of  the  situation  at  hand  in  order  to  avoid,  or  at  least 
minimize,  possibilities  for  cognitive  bias  that  may  be 
stimulated  by  an  “improper”  frame. 

Consider,  for  example,  the  decision  situation  illustrated 
in  Fig.  1.  .Alternative  B  should  be  chosen  over  Alternative 
A,  assuming  that  our  decision  rule  is  to  select  the  alterna¬ 
tive  with  the  greatest  expected  return.  Generally,  the  value 
of  money  is  not  a  linear  function  of  the  amount  of  money, 
however,  due  to  the  satiation  effect.  Also  we  have  an 
attitude  toward  risk  that  further  shapes  that  value  function 
into  a  utility  function.  These  separate  and  distinct  issues  of 
preferences  and  risk  aversion  will  be  discussed  later.  Fur¬ 
ther.  negative  outcomes  are  valued  in  a  different  fashion 
than  positive  outcomes  of  the  same  amount.  Value  func¬ 
tions  are  often  convex  for  gains  and  concave  for  losses  (9|. 

Let  us  now  examine  the  various  um  representations 
shown  in  Fig.  2  from  which  the  decision  situation  graphi¬ 
cally  illustrated  in  Fig.  1  could  have  been  obtained;  let  us 
also  speculate  on  how  the  decisionmaker  might  react  in 
each  case.  There  are  four  choice  situations  illustrated.  In 
each  case,  the  decisionmaker  is  able  to  view  the  ball  drawn 
from  the  um.  In  some  cases,  additional  information  is 
available. 

Problem  i:  Suppose  that  we  must  choose  between  the 
options  described  in  choice  situation  1.  If  we  choose  option 
A  and  a  white  or  shaded  ball  is  drawn,  then  we  obtain 
nothing.  However,  it  does  not  appear  that  we  would  feel 


Fig.  I.  Derision  tree  for  a  simple  example. 


Choice  Situation  #1 

Block  Ball,  Win  $100 

Option  A 

Urn  1  Other,  Win  $0 

Black  Ball,  Win  $500 

Option  B 

Urn  1  Other,  Win  *$100 

Choice  Situation  « 2 

Black  Ball,  Win  $100 

Option  C 

Urn  1  Other,  Win  $0 

Shaded  Ball,  Win  $500 

Option  0 

Urn  1  Other,  Win  *$100 

Choir*  Situati.n  <1 

Black  Ball,  Win  $100 

Optiou  C 

Urn  1  Other,  Win  $0 

Black  Ball,  Win  $500 

Option  F 

Urn  2  Other,  Win  -$100 

Choice  Situation  #4 

Black  Ball,  Win  $100 

Option  C 

Urn  1  Other,  Win  $0 

Shaded  Ball,  Win  $500 

Option  H 

Urn  2  Urn  2  Other,  Win  -$100 

Fig  2.  Choice  situations  that  have  a  common  derision  tree. 


badly  about  not  having  chosen  opt-on  B  since,  in  thir  tetter 
case,  we  would  surely  have  lost  money.  We  might  well  feel 
quite  good  at  choosing  option  A  and  not  choosing  option 
B.  Thus,  we  see  that  the  value  felt  from  a  decision  outcome 
may  be  a  combination  of  value  for  what  we  did  obtain,  as 
well  as  regret  or  joy  for  what  we  could  have  obtained  had 
we  chosen  the  other  option.  If  after  having  selected  option 
A,  a  black  ball  is  drawn,  we  might  or  might  not  have  regret 
associated  with  not  having  selected  option  B  where  we 
would  have  won  $500.  It  is  possible  that  we  would  just  feel 
good  about  having  played  it  safe  and  won  $100.  Altema- 
.  tively,  there  could  be  regret  at  not  having  chosen  option  B. 
It  appears  that  many  people  would  express  post-decision 
regret  at  selecting  option  A  and  obtaining  a  black  ball. 
Therefore,  the  need  to  include  regret  as  an  attribute  of  the 
descriptive  choice  situation  becomes  more  apparent. 

Suppose  that  we  choose  option  B.  If  a  white  or  shaded 
ball  is  drawn,  it  is  very  possible  that  we  would  feel  badly 
about  having  been  greedy  and  chosen  option  B  over  the 
safer  bet  of  selecting  option  A.  Thus,  there  exists  regret 
associated  with  this  choice.  Here,  again,  one  experiences 
post-decisional  regret.  If  a  black  ball  is  drawn,  we  would  be 
quite  happy  with  having  selected  option  B  in  the  first 
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($100;  feel  good  about  winning  but  regret  not  selecting  option  B) 


1  ($0;  bad  fe 
/this  case  a 


feeling  about  not  winning  but  glad  option  A  selected  in 
ince  there  would  have  been  a  loss  with  B) 


($500;  feel  really  good  about  winning  and  glad  that  option  B  was  selected) 


(-$100;  feel  bad 
\and  lost  $100  by 


badly  about  losing  and  regret  having  been  greedy 
choosing  option  B) 


<») 


($100;  feel  good  about  winning;  feels  really  good  about  selecting  option  C) 

($0;  bad  feeling  about  losing  and  really  feels  badly  about  selecting 
option  C  as  option  0  would  have  resulted  in  a  win  of  $500) 

($0;  bad  feeling  about  losing  but  glad  option  C  selected  in  this  case) 

(-$100;  bad  feeling  about  losing  and  really  feels  badly  about 
having  been  greedy  and  not  choosing  option  C) 

($500;  really  feel  great  about  having  won  and  having  chosen  option  D) 

(-$100;  bad  feeling  about  losing  and  having  been  greedy  and  not 
choosing  option  C) 


<b) 


l$100;  feel  gooo  about  winning  and  no  regret  about  not  selecting  option  F) 

($0;  bad  feeling  about  losing  but  no  regret  about  not  selecting  option  F) 

($500;  feel  really  good  about  winning  and  glad  option  F  was  selected) 

(-$100;  bad  feeling  about  losing  and  regret  having  been  greedy  and 
and  lost  $100  as  no  loss  would  have  been  possible  under  option  F.) 


(C) 

Fig.  3.  Decision  tree  with  outcomes  characterized  by  happiness  outcome  and  post-decision  regret,  (a)  Problem  1.  (We  are 
allowed  to  see  outcome  results  for  options  not  selected.)  (b)  Problem  2.  (We  are  allowed  to  see  outcome  results  from  options 
not  selected.)  (c)  Problem  3.  (We  are  not  allowed  to  see  outcome  results  from  options  not  selected.) 


place  Again,  we  see  a  post-decision  effect,  bliss  or  sadness, 
that  is  modified  from  the  pre-decision  situation. 

Problem  2:  Suppose  that  we  must  choose  between  the 
options  described  in  choice  situation  2  of  Fig.  2.  If  a  black 
ball  is  drawn,  we  should  really  feel  good  about  having 
selected  option  C  instead  of  option  D.  One  hundred  dollars 
would  have  been  lost  had  option  D  been  selected.  If  a 
shaded  ball  is  drawn,  no  money  is  lost,  but  $500  would 
have  been  won  had  option  D  been  selected.  Here,  we  may 
feel  quite  badly  about  not  having  selected  D  in  the  first 
place  as  we  know,  post-decision,  that  we  would  have  won  if 
we  had  selected  option  D.  If  a  white  ball  is  drawn,  we  are 
likely  rather  glad  that  option  D  was  not  selected,  since 
there  would  have  been  a  loss  of  $100  with  this  option. 
Suppose  that  we  choose  option  D.  If  a  white  ball  is  drawn, 
we  would  most  likely  feel  badly  about  having  been  greedy 
in  selecting  option  D  instead  of  option  C.  If  a  black  ball  is 
drawn,  we  would  probably  feel  badly  about  not  having 
selected  option  C.  Finally,  if  a  shaded  ball  is  drawn,  then 
we  would  probably  feel  good  over  having  both  drawn  the 
shaded  ball  and  selected  option  D. 

Problem  3:  Assume  that  we  are  only  informed  that  we 
have  won  or  lost  according  to  the  color  of  the  ball  drawn. 


This  "nay  be  represented  by  the  two-urn  mode!  for  choice 
situation  number  3  or  4  involving  options  E  and  F  for 
situation  3,  or  G  and  H  for  situation  4.  Suppose  that  we 
choose  option  E.  If  a  white  ball  or  a  shaded  ball  is  drawn, 
we  are  simply  informed  of  the  loss.  Since  there  is  no  way  of 
determining  what  would  have  been  the  outcome  had  the 
other  option  been  selected,  we  have  no  basis  for  regretting 
not  having  chosen  the  other  option.  If  a  black  ball  is 
drawn,  we  are  informed  that  we  have  won.  Since  there  is 
no  way  of  determining  what  would  have  occurred  had  the 
other  option  been  selected,  we  can  only  be  happy  about 
having  won.  We  surely  should  not  assume  that  we  would 
have  obtained  a  black  ball  if  we  selected  option  F  in  choice 
situation  3  where  we  would  be  happier,  or  in  option  H 
where  we  would  be  very  sad.  Suppose  that  we  do  choose 
option  F.  If  a  white  or  shaded  ball  is  drawn,  we  would  only 
feel  badly  about  having  lost.  There  should  be  no  regret.  If  a 
black  ball  is  drawn,  we  would  be  happy  with  having  gone 
for  the  “big  win”  and  won. 

In  our  discussion,  we  assumed  that  the  decisionmaker 
had  explicit  information  available  concerning  the  outcomes 
from  the  option  not  selected  in  choice  situations  1  and  2, 
the  one-urn  problems.  We  assumed  that  no  information 


SAGE  AND  WHITE:  DECISION  AND  INFORMATION  STRUCTURES 


139 


was  available  concerning  the  outcomes  from  the  option  not 
selected  in  choice  situations  3  and  4,  the  two-um  problems. 
Even  though  there  are,  indeed,  subtle  differences  that  are 
perceived  to  exist  between  the  choice  situations,  they  are 
sometimes  modeled  in  the  same  way  in  the  decision  tree 
representation  shown  in  Fig.  1,  which  is  a  good  representa¬ 
tion  of  the  decision  tree  portion  of  the  decision  situation. 
However  it  is  not  a  good  representation  of  the  attributes  of 
decision  outcomes.  For  this,  we  need  an  attribute  tree,  or  a 
more  complete  labeling  of  the  outcomes  in  terms  of  their 
attributes,  as  shown  in  the  decision  tree  of  Fig.  3.  Even  in 
the  very  simple  situations,  we  see  that  we  have  identified 
two  attributes  associated  with  the  outcomes.  These  are  the 
amount  of  money,  won  or  lost,  and  the  regret,  or  rejoicing, 
associated  with  what  could  have  been  obtained  from  the 
decision  not  selected. 

In  the  single-urn  model,  we  generally  have  post-decision 
regret  or  post-decision  conflict  associated  with  outcomes. 
In  the  two-um  model,  we  do  not  generally  have  post-deci¬ 
sion  regret  since  we  do  not  know  the  outcome  for  the 
option  not  selected.  The  central  issue  in  this  is  that  the 
decision  situation  model  should  not  be  the  s?me  for  ell  o' 
these  choice  situations.  The  outcomes  and  the  associated 
values  are  not  the  same,  and  our  feelings  towards  them  are 
not  the  same  since  the  available  information  is  different 
in  each  case.  Post  outcome  information  about  outcomes 
from  decisions  not  selected  is  both  context  dependent  and 
different  from  predecision  information.  Thus,  we  need  to 
examine  models  which  allow  inclusion  of  the  available  pre- 
and  post-decision  information  on  choice  situations. 

In  each  of  the  problems  just  described,  the  probabilities 
of  winning  were  the  same;  however,  the  amount  to  win 
varied.  Now  consider  the  decision  situations  represented  in 
Fig.  4  where  options  /  and  K  result  in  a  0.043  chance  of 
winning  S1000  and  options  J  and  L  result  in  a  0.03  chance 
of  winning  $750.  The  dccis^n  opti  ms  rcprerci  ted  in  choice 
situation  6  are  such  that  one  knows  exactly  what  would 
have  been  won  or  lost  for  both  options  once  an  outcome 
has  been  observed.  The  lotteries  represented  in  choice 
situation  3  are  such  that  there  is  no  means  of  determining 
what  would  have  been  won  or  lost  had  the  other  option 
been  selected.  There  are  many  other  urn  representations 
which  result  in  different  post-decision  information  avail¬ 
able  to  the  decisionmaker  that  will  have  the  same  decision 
tree  representation,  even  though  the  pre-decision  informa¬ 
tion  is  the  same. 

Fig.  5  presents  the  information  that  the  decisionmaker 
has  available  (post-decision)  under  the  framings  repre¬ 
sented  in  choice  situations  5  and  6.  Again,  we  see  that  the 
attributes  of  the  choice  situations  may  be  quite  different. 
We  wish  to  explore  the  implications  of  this  here.  The 
primary  questions  that  we  wish  to  resolve  in  this  paper  are 
as  follows. 

1)  Is  there  a  difference  between  choice  situations  1,  2,  3, 
and  4?  Should  there  be  a  difference  with  respect  to 
judgment  concerning  the  most  preferred  alternatives 
in  each  situation? 


Urn  3 


Choice  Situation  #5 

Drew  Shaded  Ball,  Win  $1000 

Option  I 

Urn  3  Draw  White  Ball,  Win  $0 


Urn  5 


Draw  Black  Ball,  Win  $750 

Option  J 

Urn  4  Draw  White  Ball,  Win  $0 


Choice  Situation  #6 

Draw  Black  Ball,  Wia  $1000 

Option  K 

Urn  5  Draw  Shaded  or  White  Ball.  Win  $0 


Draw  Black  or  Shaded  Ball,  Win  $750 

Option  i 

Urn  5  Draw  White  Ball,  Win  $0 


Fig.  4.  Um  model  representation  of  two  different  choice  situations. 


2)  Is  there,  and  should  there,  be  a  difference  between 
choice  situations  5  and  6? 

3)  What  constructs  are  available  to  explain,  in  descrip¬ 
tive  and  normative  senses,  any  differences  in  these? 

4)  Are  there  possibilities  for  nontransitivities  or  other 
anomalous  resu'ts  from  us;n?  these  constructs? 


III.  The  Need  for  Available  Information 
Sensitive  Theories  of  Regret 

Bell  (l]-[3)  was  perhaps  the  first  to  advocate  the  inclu¬ 
sion  of  regret  as  a  second  attribute  to  more  fully  capture 
the  decisionmaker’s  values.  It  has  often  been  suggested  that 
regret  be  used  as  a  surrogate  for  value  and  that  an  option 
alternative  be  selected  which  minimizes  regret.  But  regret, 
in  the  definitive  work  of  Bell,  is  measured  against  some 
idea)  best  and  worst  outcomes,  associated  with  the  specific 
choice  situation,  and  these  same  anchors  are  used  to  mea¬ 
sure  regret  for  all  outcomes.  Bell’s  effort,  and  related 
independently  obtained  results  due  to  Loomes  and  Sugdrn 
[13],  consider  value  and  regret  as  simultaneously  present 
attributes  of  decision  outcomes.  Two-option  situations  are 
considered,  and  regret  is  a  differential  concept  that  is 
measured  within  the  outcome  states  across  the  options  that 
could  have  led  to  these  states,  as  in  Bell’s  work. 

This  method  appears  applicable  in  two  outcome  win/lose 
situations  where  the  selection  of  a  winner  in  one  choice 
would  result  in  post-decision  error-free  identification  of  a 
win  or  loss  situation  had  the  other  option  been  selected. 
There  are,  of  course,  many  examples  of  decision  situations 
where  one  may  obtain,  post-decision,  full  knowledge  about 
what  would  have  happened  under  the  option  not  selected. 
There  are,  however,  other  decision  situations  where  com¬ 
plete  post-decision  knowledge  about  what  would  have  hap¬ 
pened  under  the  option  not  selected  is  not  available.  Also 
there  are  many  decision  situations  which  involve  more  than 
two  alternative  courses  of  action.  This  effort  extends  regret 
theory  to  incorporate  these  considerations. 

Consider,  for  example,  the  problem  represented  in  Fig.  6 
where  option  A  gives  $1000  with  probability  0.9  and  $0 
otherwise.  Option  B  gives  $750  for  sure.  The  choice  of 
option  B  over  lottery  A  may  be  attributed  to  a  certainty 


IEEE  TRANSACTIONS  ON  SYSTEMS.  MAN,  AND  CYBERNETICS,  VOL.  SMC- 13,  NO.  3,  MARCH/APRJL  1983 


($1000;  feels  good  about  having  won,  no  regret  about  having  selected  I) 


($0;  feel  badly  about  having  lost,  no  regret  about  having  selected  1) 
($750;  feel  good  about  having  won;  no  regret  about  having  selected  J) 


($0;  feel  badly  about  having  lost;  no  regret  about  having  selected  J) 


-($1000;  feel  good  about  having  won;  feel  good  about  selecting  C) 


7005 

whitens.  .950 


-($0;  feel  badly  about  having  lost;  regret  having  selected  C) 

‘($0;  feel  badly  about  having  lost;  indifferent  about  having  selected  C) 
-.($750;  feel  good  about  having  won;  possibly  would  feel  better  if  C  selected) 


- -5-— Q05-  ($750;  feel  good  about  having  won;  rather  happy  about  having  selected  D) 

\  .950 

white  \ 

' - ($0 ;  feel  badly  about  having  lost;  indifferent  about  having  selected  0) 

<b) 

Fig.  3.  Illustrations  of  regret  as  post-decision  outcome  attribute,  (a)  Choice  situation  3.  (b)  Choice  situation  6. 


Fig.  6.  General  problem  which  illustrates  certainty  effect. 

effect;  we  prefer  a  certain  S750  to  a  0.9  chance  of  winning 
SI 000  and  a  0.1  chance  of  winning  SO.  In  the  full  informa¬ 
tion  framing  situation,  the  decsionmaker  views  the  problem 
as  shown  in  Fig.  7.  In  the  ordered  pair  (a,  b },  the  first 
attribute  a  represents  what  we  actually  gain  or  lose  and  the 
second  attribute  b  represents  the  assets  foregone  by  not 
having  selected  the  other  alternative.  We  assume  a  linear 
multiattribute  utility  function  form  such  that  for  n  outcomes 
of  a  decision  alternative  A,  we  have 

mA)-Itp,(A)[vl(A)+fl(A)].  (1) 

Here p,(A)  is  the  probability  of  obtaining  outcome  /  given 
that  option  A  is  selected.  v,(A)  is  the  value  associated  with 
obtaining  outcome  i  from  selection  of  option  A.  ft(A)  is  the 
regret  associated  with  obtaining  outcome  i  from  option  A 
and  not  obtaining  “some  other  outcome.’’  Clearly,  we  need 
to  be  careful  in  anchoring  this  other  outcome.  In  order  to 
have  option  B  preferred  to  option  A,  B  >  A,  we  must  have, 
where  we  let  u(lQ00)  -  I  and  u(0)  -  0,  and  now  use  /(a) 


Option  A 


Option  B 


Choice  Situation  7 

Black  Ball  Drawn,  Win  M 


White  Ball  Drawn,  Win  $0 
Black  Ball  Drawn,  Win  C 
White  Ball  Drawn,  Win  C 


©-"■ 

VO"y 


(M,  M-C) 


(0,  -C) 


(C,  C-M) 


Fig.  7.  Regret  model  of  a  decision  situation  represented  by  um  model 
shown — illustration  of  certainty  effect. 

to  represent  the  regret  associated  with  obtaining  the  out¬ 
come  a, 

p[l+f(M-C)]  +  (l-p)f(-C)i 

<v(C)+pf(C-  M)  +  (l -p)f(C).  (2) 

The  second  attribute  in  the  ordered  pair  is  referred  to  as 
the  foregone  assets  since  it  is  just  the  difference  between 
the  outcome  actually  realized  and  the  outcome  in  the  other 
lottery.  It  is  very  important  to  note  that  value  here  is  a 
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Choice  Situation  8 


Option  A  Option  B 

Draw  black  ball,  win  $1000  Draw  black  ball,  win  $750 

Draw  shaded  ball,  win  $0  Draw  shaded  ball,  win  $750 

a 

p  “  n+n 


cardinal  v-lue  function  measured  with  some  presumed 
anchor  whereas  regret  is  a  differential  cardinal  measure 
anchored  on  another  outcome  that  “could  have  been.” 

This  procedure  suffices  for  the  special  case  where  the 
problem  being  evaluated  may  be  represented  by  the  one- 
urn,  two-outcome  full  information  model  shown  in  Fig.  7. 
In  this  case,  if  one  wins  or  loses  after  having  selected  one 
option,  then  it  can  be  determined  whether  one  would  have 
won  or  lost  had  the  other  option  been  selected.  However, 
suppose  that  Fig.  6  was  intended  to  be  representative  of 
the  two-urn  problem  shown  in  Fig.  8.  There  are  only  two 
cases  associated  with  the  model  of  Fig.  8  where  regret 
enters  the  decision  situation  as  a  second  attribute.  These 
involve  option  A.  If  we  select  option  B  and  the  certain 
return,  tbert  is  no  way  of  knowing  whether  we  would  have 
won  or  lost  had  the  other  urn  been  selected. 

A  question  of  significant  interest  is  whether  or  not 
post-decision  knowledge  of  the  outcomes  increases  or  de¬ 
creases  the  overajl  utility  of  the  certain  outcome  alternative 
B.  The  value  of  B,  with  no  post-decision  information  about 
the  outcomes  obtained  from  alternative  A  available,  is 
u(C).  With  post-decision  information  (regret  information) 
available,  it  is  (from  Fig.  7) 

EU{B)  -  v(C)  +  pf(C  -  M)  +  (l  -  p)f(C)  (3) 

The  answer  to  our  question  seemingly  lies  in  the  regret 
function.  Post-decision  outcome  information  will  increase 
the  utility  of  alternative  fi,  relative  to  that  of  alternative  B, 
such  that  B  >  B,  if  EU(B)  -  EU(B)  >  0,  or  if 

P/(C  —  M)  +  (l  —  p)f(C)  <  0  (4) 

and  will  decrease  the  utility  of  alternative  B,  relative  to 
that  of  alternative  B,  such  that  B  >  B,  if 

pf(C-  M)  +  (\-p)f(C)>0.  (5) 

The  alternatives  A  and  A  should  have  the  same  expected 
utility  here  for  these  pairwise  preference  comparison  exam- 
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pies,  since  we  know  in  each  case  what  outcome  occurs  from 
the  option  not  selected.  We  will  have  alternative  A  preferred 
to  B,  A  >  B,  if 

p[\+f(M-C)]  +  (\-p)f(-C)>v(C),  (6) 

where  we  let  /( 0)  =  0  for  convenience.  We  see  that  there 
will  exist  preference  reversals,  B  >  A  -  A  >  B,  if  (2)  and 
(6)  are  satisfied.  If  this  occurs,  (5)  is  satisfied.  In  a  similar 
way  we  obtain  preference  reversals,  B  >  A  -  A  >-  B,  if 
neither  (2)  nor  (6)  is  satisfied.  If  this  occurs,  (4)  is  satisfied. 
Thus  we  see  that,  under  appropriate  circumstances,  prefer¬ 
ence  reversals  may  be  made  to  occur  by  changing  the 
information  set  available  to  the  decisionmaker.  Changing 
the  probabilities  of  obtaining  the  outcomes  may  also  result 
in  preference  reversals.  In  most  cases  we  expect  that  greater 
post-decision  outcome  information  will  increase  the  utility 
of  the  certain  outcome  alternative,  assuming  it  is  favorable, 
relative  to  the  uncertain  outcome  alternative,  and  then  we 
expect  (S)  to  hold. 

An  interesting  modification  to  the  um-model  decision 
situations  can  be  made  by  inserting  k  no-win  white  balls  in 
each  urn  for  the  decision  situations  depicted  in  Figs.  7  and 
8.  The  resulting  situations  are  just  those  depicted  in  Figs.  4 
and  3  for  a  specific  set  of  numbers  for  k,  m,  and  n.  We 
preserve  the  regret  that  is  associated  with  choice  situation  7 
but  the  certainty  effect  associated  with  choice  situation  8 
seems  to  vanish.  There  is  now  no  certain  way  of  knowing 
what  would  have  occurred  under  outcome  B  if  we  select 
option  A.  Of  course,  if  k  is  small  we  have  a  relatively  good 
idea  of  what  would  occur,  but  there  is  no  way  in  which  we 
can  know  for  sure.  Suppose,  for  example,  that  we  let 
M  =•  $1000,  C  =  $750,  m  =  45,  and  n  =  5.  It  seems  not  at 
all  unreasonable  that  we  prefer  choice  A  to  choice  B  in 
choice  situation  7  and  B  >  A  in  choice  situation  8. 

Now  suppose  we  add  k  =  950  white  balls  to  each  urn. 
We  then  obtain  the  decision  situation  structural  models  of 
Fig.  5.  Our  preferences  should  remain  the  same  regardless 
of  k  if  we  assume  that  conventional  utility  theory  is  fully 
applicable.  The  sure  thing  principle  of  Savage  and  the 
strong  independence  axiom  of  Samuelson  each  require  this. 
These  early  seminal  results  in  decision  analysis  are  based 
on  the  assumption  that  pre-decision  and  post-decision  re¬ 
gret  information  is  the  same. 

It  is  very  likely,  however,  that  v<*  will  prefer  the  more 
risky  options  A  and  A  since  there  is  a  33  percent  greater 
return  with  only  slightly  greater  risk.  At  first  glance,  this 
might  appear  to  contradict  the  results  that  follow  from  use 
of  (6).  However  (6)  is  formally  not  applicable  as  addition 
of  the  k  white  balls  to  the  um  has  modified  the  informa¬ 
tion  content  present.  Now  we  no  longer  know  that  option 
B  will  produce  a  winner,  and  the  decision  situation  model 
is  now  that  of  Fig.  5(a)  and  not  that  of  Fig.  8. 

The  significance  of  this  observation  is  that  a  knowledge 
of  information  patterns  in  the  decision  situation  model  is 
essential;  and  that  the  notion  of  “regret”  is  not  at  all 
independent  of  risk  levels,  especially  when  there  are  post¬ 
decision  information  uncertainties.  If  k  -  1,  for  example,  it 
is  quite  obvious  that  the  regret  model  of  Fig.  8  would  be 
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more  applicable  than  that  of  Fig.  5(a).  However,  when 
there  is  full  post-decision  outcome  information,  then  it 
would  appear  that  regret  is  not  strongly  dependent  upon 
the  risks  involved.  With  k  -  950  such  that  Fig.  5(b)  results 
for  the  full  post-decision  outcome  information  case,  and 
with  k  »  0  for  which  we  obtain  Fig.  7,  the  regret  terms  are 
essentially  the  same. 

There  have  been  a  number  of  attempts  to  illustrate  the 
nonrationality  of  choices  which  violate  one  or  more  of  the 
classic  axioms  of  decision  theory.  We  shall  briefly  examine 
a  simple  situation  which  is  illustrative  of  these  here.  Our 
purpose  in  doing  this  is  to  demonstrate  the  need  to  care¬ 
fully  construct  decision  situation  structural  models,  espe¬ 
cially  with  respect  to  information  flow  patterns,  including 
the  nature  of  any  “regret”  that  is  associated  with  the 
decision  situation.  In  the  “full  information”  case  illustrated 
in  Fig.  7  many  people  will  prefer  B  -  (C,  1)  to  A  =  ( A/,  p) 
but  will  prefer  A  =  (M,  ap)  to  B  <*  (C,  a),  where  M  >  C 
and  0  <  a,  p  <  1.  There  are  at  least  two  decision  matrices 
which  may  be  claimed  to  describe  this  decision  outcome 
situation: 


Option 

1 

|  ^ 

(a)  Probability  of  Outcome 
ap(  1  -  a)  (1  -  ap)a 

(1  -  o)(l  -  ap) 

A 

M 

M  0 

0 

B 

C 

0  C 

0 

Option 

(b)  Probability  of  Outcome 
ap  a(l  -  p) 

1  -  a 

A 

M  0 

0 

B 

C  C 

0 

In  each  of  the  above  matrices  we  have  A  =  A(a  =  1)  and 
B  =  B(a  =  1).  The  question  which  immediately  arises  is: 
what  does  “full  information”  infer  here?  The  answer  is  that 
there  is  no  answer  to  the  question  as  posed.  We  simply 
must  know  about  the  decision  situation  structural  model  or 
f.ame  used  to  represent  the  task  at  har.d.  We  may  repre¬ 
sent  these  two  “full  information”  decision  situations  by  the 
urn  models  and  decision  trees  of  Fig.  9.  If  we  view  value 
and  regret,  and  probability,  as  the  components  of  utility, 
the  decision  criteriafor  these  two  frames  are  quite  different 
and  given  by  A  >  B  if  we  have 

p  -  v(c)  +  ap[f(M  -  C)-f(C-M)]  +p(l-a) 

■  [/(AO -f(-M)]  +  (1  -  ap)[f{-C)  -/(C)]  >  0 
for  the  situation  model  of  case  a  and 
P-v(c)+p[/(M-C)-f(C-M)] 

+  (1  -p)[/(-C)-/(C)]>0 

for  the  situation  model  of  case  b.  Here  we  let  u(0)  =  0  and 
v(M)  »  1.  It  is  this  latter  situation  model  that  we  have 
considered  in  our  previous  discussions.  For  the  situation 
model  of  Fig.  9(b)  we  go  from  options  A  and  B  to  options 
A  and  B  by  changing  a  from  some  small  number  (typically) 
to  1 .  This  simply  means  that  we  remove  shaded  balls  from 
the  urn  in  Fig.  9(b).  In  each  case,  we  obtain  the  standard 
utility  expressions  if  we  remove  the  regret  terms.  Also,  the 
certainty  effect  is  absent  in  the  model  of  Fig.  9(b). 
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Fig.  9.  Two  different  information  flow  models  which  yield  same  pros¬ 
pects.  fa)  Decision  situation  model  for  case  a.  (b)  Decision  situation  for 
case  b. 


By  no  means  does  this  discussion  suggest  that  the  situa¬ 
tion  model  of  Fig.  9(b)  is  more  realistic  than  that  of  Fig. 
9(a).  A  judgment  of  this  sort  must  necessarily  depend  upon 
the  task  at  hand.  If  we  consider  the  specific  situation  where 
C  =  S5000,  M  =  S4500,  p  =  0.98  and  a  =  0.05  then 
changing  a  to  1  results  in  quite  different  frames  of  the 
decision  situation  as  indicated  in  Fig.  10,  which  is  com¬ 
puted  with  n  =  1000.  To  use  either  of  these  models  re¬ 
quires  some  illustration  of  the  physical  situation  involved! 

Thus,  it  is  not  fully  meaningful  to  speak  of  value  and 
regret  associated  with  prospects  A  =*  (M,  p)  and  B  = 
(C,  1).  There  is  no  formal  difficulty  in  using  the  value 
concept  since  it  is  presumably  anchored  on  some  ideal  best 
and  ideal  worst  possibilities.  However  the  regret  concept  is 
based  upon  opportunity  foregone  by  not  selecting  the  other 
option  and  the  question  immediately  arises  concerning 
available  information  about  what  we  would  have  obtained 
under  the  option  not  selected.  The  conclusion  that  we  must 
exercise  considerable  care  in  obtaining  the  decision  situa¬ 
tion  structural  model  is  inescapable. 
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(a) 


(b) 


Fig.  10.  Illustration  of  urn  model  changes  for  two  different  decision  frames,  (a)  Case  a.  (b)  Case  b. 


IV.  The  Potential  for  Nontransitive  Behavior 
Using  Pairwise  .Regret  Comparisons 

It  is  well-known  that  sets  of  pairwise  preference  com¬ 
parisons  are  often  nontransitive.  This  may  well  occur  using 
the  regret  concepts  presented  here  since  the  regret  associ¬ 
ated  with  selecting  an  alternative  must  necessarily  be  asso¬ 
ciated  with  the  alternative  not  selected.  Thus  it  is  not 
meaningful  to  speak  of  the  expected  utility  of  alternative  A 
when  regret  associated  with  not  selecting  alternative  B  is 
involved.  We  should  use  for  (1) 

N 

eu(a,  b)  =  £  P,(>0h(/1)  +/,u.  5)]. 

/- 1 

where  the  u,(/U  are  the,  perhaps  multiattributed,  compo¬ 
nents  of  the  ut  '.ty  of  the  »'th  outcome  of  option  A;  the 
/,( A,  B)  are  the  regrets,  which  are  negative  for  true  regret 
and  positive  for  rejoicing,  associated  with  obtaining  the  ith 
outcome  from  alternative  A  rather  than  the  possibly  known 
outcome  associated  with  rejecting  alternative  B\  and  the 
p,(A)  are  the  probabilities  associated  with  obtaining  the 
ith  outcome  state  following  choice  of  alternative  A.  It  is 
very  convenient  but  not  strictly  necessary  that  this  proba¬ 
bility  be  the  same  across  the  N  outcome  states  for  options 
A  and  B.  When  these  probabilities  are  not  the  same  we 
must  generally  reformulate  the  situation  model  in  a 
meaningful  way  such  that  we  obtain  p,(A)  **  p,(B).  We 
will  say  that  A  >  B  if  EU(A,  B)  >  EU(B ,  A).  From  this, 
we  easily  see  that  there  is  no  reason  to  infer  that  if  A  >  B 
and  B  >  C,  we  must  necessarily  have  A  >  C.  Fig.  11 
illustrates  a  three-choice  situation  with  preference  intransi- 
tivities  that  occur  because  of  the  different  information  sets 
available  in  the  three  pairwise  preference  comparisons. 
This  would  suggest  much  caution  in  the  use  of  any  prioriti¬ 
zation  approach  that  is  based  on  pairwise  preference  com¬ 
parisons  and  assumed,  but  nonverified,  transitivity  among 
preference  relations  as  it  becomes  extraordinarily  easy  to 
produce  agenda  dependent  results. 


V.  Conclusion 

In  this  paper,  we  have  examined  the  recently  introduced 
concept  of  pairwise  comparison  regret.  As  expected,  the 
regret  concept  does  not  necessarily  lead  to  transitive  pref¬ 
erence  comparisons.  We  have  demonstrated  the  strong 
need  to  incorporate  decision  process  descriptions  in  fram¬ 
ing  of  regret  situations.  Several  illustrative  examples  indi¬ 
cate  that  the  framing  of  decision  output  states  and  the 
information  available  concerning  the  outputs,  resulting 
from  decision  options  not  selected,  greatly  influences  the 
regret  calculations.  The  central  conclusion  from  this  is  that 
careful  decision  situation  structuring  must  be  associated 
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with  the  regret  concept  if  the  results  obtained  are  to  have 
descriptive  value. 

Even  more  interesting  and  potentially  useful  questions 
concern  usefulness  of  the  regret  concepts  in  a  normative 
sense.  Clearly,  many  people  experience  notions  of  regret 
and  hesitate  rejecting  alternatives  because  of  some  desir 
able  properties  of  the  rejected  alternatives  that  will  then  be 
foregone.  We  must  be  careful  however  to  note  that  the 
“preference”  relation  implied,  through  use  of  regret,  by 
A  >  B  is  not  just  “A  is  preferred  to  B”  but  “selecting  A 
and  rejecting  B  is  preferable  to  selecting  B  and  rejecting 
A."  Thus  the  two  preference  relations  A  >  B  and  B  >  C 
do  not  provide  sufficient  information  to  infer  A  >  C.  The 
contextual  relation  >  is  not  uniquely  defined  here.  It 
should  really  be  written  to  infer  the  true  contextuality  of 
the  situation  at  hand.  What  we  have  really  shown  is  that 
A  >■  abB  and  B  > BCC  do  not  necessarily  allow  us,  when 
comparing  A  and  C,  to  say  anything  about  >  AC.  It  might 
well  be  a  serious  mistake  to  use  approaches  which  infer 
that  it  does  if  we  allow  for  pairwise  comparisons  of  this 
sort. 

Wt  agree,  strongly,  with  the  comment  of  Rahneman  and 
Tversky  [9]  that  those  departures  from  subjective  expected 
utility  theory  that  prospect  theory  (and  regret  theory  as 
well)  describes  “must  lead  to  normatively  unacceptable 
consequences.”  A  well-conceived  decision  support  process 
should  assist  the  decisionmaker  in  understanding  the 
potential  decision  process  errors  involved  in  the  use  of 
flawed  judgment  heuristics.  For  these  reasons,  among 
others,  we  strongly  encourage  elicitation  processes  that 
encourage  comparison  within  attributes  and  across  out¬ 
come  states  for  alternatives.  It  would  seem  that  pairwise 
preference  comparison  of  alternatives  is  fraught  with  diffi¬ 
culties  and,  unless  great  care  is  exercized,  can  lead  to 
potentially  misleading  results.  At  the  very  least,  we  must  be 
fully  aware  of  the  potentially  context  and  associated  fram 
ing  dependent  definition  of  the  pairwise  relation,  >  ,  and 
that  this  relation  is,  strictly  speaking,  incomparable  in  the 
expressions  A  >  abB  and  B  > BCC  when  these  expressions 
imply  pairwise  comparison  with  no  ideal  alternatives  to 
serve  as  a  reference  point,  anchor,  or  basis  for  the  compari¬ 
son.  In  other  words,  we  must  be  careful  to  insure  that  the 
relation  is  defined  in  a  fashion  such  that  it  is  context 
independent  across  alternatives  if  we  are  to  use  it  in  the 
manner  indicated  here,  for  multiple  pairwise  comparisons 
across  alternatives. 

This  cannot,  however,  be  used  as  an  invocation  against 
using  the  regret  concept,  or  the  more  general  prospect 
theory,  to  describe  behavior.  For  descriptive  purposes  these 
approaches  have  much  to  recommend  them.  Understand¬ 
ing  of  descriptive  reality  is  a  necessary  first  step  towards  a 
meaningful  normative  process.  In  this  sense,  among  others, 
these  approaches  have  considerable  value.  And,  of  course, 
it  may  well  turn  out  that  the  regret  approach,  with  suitable 
information  framing,  will  not  lead  to  preference  nontransi¬ 
tivities.  In  this  case,  assuming  validity  of  the  value  and 
regret  elicitations  [8],  [12j,  the  approach  would  seem  to 


have  much  potential  normative,  as  well  as  descriptive, 
appeal. 

A  number  of  extensions  to  our  efforts  suggest  them¬ 
selves.  Two  that  seem  particularly  cogent  concern  examina¬ 
tion  of  regret  elicitation  approaches  and  a  closer  compari¬ 
son  contrast  and  integration  of  the  regret  concept  with 
prospect  theory  [7],  [9],  [21],  other  axiomatic  approaches 
[14],  especially  the  insightful  generalized  expected  utility 
analysis  of  Machina  [IS],  [16]  in  which  a  nonlinear  value 
functional  is  proposed  which  depends  upon  event  outcome 
probability  as  an  attribute  and  where  only  a  local  linear 
utility  function  satisfies  the  savage  substitution  axiom,  and 
the  recently  introduced  very  promising  concept  of  relative 
risk  aversion  due  to  Dyer,  Sarin,  and  Krzysztofowicz  [4], 
(111- 
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Multiple  objective  evaluation  and  prioritization  under  risk 
with  partial  preference  information  t 

CHELSEA  C.  WHITE  III+  and  ANDREW  P.  SAGE* 

Much  current  interest  surrounds  the  design  and  development  of  interactive  multi¬ 
criterion  decision  support  processes.  We  consider  a  finite  alternative  course  of 
action,  a  single-stage,  decision  situation  model  under  risk  with  multiple  attributes, 
criteria  or  objectives.  In  this  approach,  a  decision-maker  is  able  to  select  interactively 
and  iteratively  a  mixture  of  complete  judgement  (e.g.  intuitive  affect),  heuristic 
elimination  (e.g.  elimination  by  aspects),  and  holistic  assessment  (e.g.  expected 
utility  theory)  of  partial  preference  information  to  enable  aggregation  of  some,  but 
not  necessarily  all,  criteria  or  attributes.  We  consider  three  dominance  relations 
on  the  alternative  set :  expected-value  score  dominance,  first-order  stochastic 
dominance,  and  second-order  stochastic  dominance.  Two  important  issues  are 
resolved  here.  The  first  of  these  involves  establishment  of  the  impact  of  various 
forms  of  partial  objective  aggregation  information,  in  the  form  of  attribute  weights, 
upon  dominance  relations  for  the  alternative  option  set.  The  second  concerns  the 
computational  tractability  of  the  second-order  dominance  relations.  In  resolving 
the  first  issue,  we  show  that  under  suitable  conditions  that  will  almost  always  prevail, 
additional  attribute  aggregation  information  implies  greater  alternative  discrimination 
specificity  for  the  three  dominance  relations  considered.  A  fourth  dominance  relation 
is  defined  that  represents  a  computationally  attractive  upper  bound  on  the  numeri¬ 
cally  demanding  second-order  stochastic  dominance  relation.  The  ultimate  goal  of 
the  proposed  procedure  is  rational  and  behaviourally  relevant  assistance  in  the 
search  for  a  dominance  structure. 


1.  Scope  and  purpose 

In  this  paper,  we  consider  two  behaviourally  relevant  issues  that  arise 
from  the  application  of  a  recently  developed  decision  aiding  approach  to  an 
important  class  of  multiple  objective  decision-making  problems  under  risk. 
A  key  characteristic  of  the  decision  aiding  approach  is  that  the  decision-maker 
may  iteratively  and  interactively  select  the  mix  of  effort  devoted  to  ( 1 )  assess¬ 
ing  the  relative  importance  of  some,  but  not  necessarily  all,  objectives,  and 
(2)  completely  selecting  the  most  preferred  alternative  on  the  basis  of  a 
dominance  structure.  The  two  issues,  posed  as  questions,  are:  (1)  does 
more  of  the  former  type  of  effort  reduce  the  requirements  for  effort  of  the 
latter  type  :  and  (2)  is  the  application  of  the  decision  aiding  approach  to 
this  class  of  problems  amenable  to  interactive  computing  In  resolving  the 
first  issue,  we  show  that  under  mild  and  generally  prevalent  conditions,  more 
information  assessed  regarding  the  relative  importance  of  the  objectives  or 
attributes  tends  to  reduce  the  number  of  candidates  for  the  most  preferred 
alternative.  With  respect  to  the  resolution  of  the  second  issue,  we  present 
an  approximation  that  is  substantially  more  computationally  attractive  than 
an  important  method  for  determining  the  second-order  stochastic  dominance 
relation  and  associated  preferences  among  the  alternatives.  These  results. 
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we  feel,  significantly  enhance  the  potential  computational  efficiency  and 
effectiveness,  and  hence  acceptability,  of  interactive  multicriterion  decision 
aiding  approaches. 

2.  Introduction 

Many  decision  situations  can  be  characterized  as  choice  problems  that 
involve  selection  of  a  preferred  alternative,  or  sometimes  selection  of  the  X 
most  preferred  alternatives,  from  among  a  finite  number  of  alternatives  in  a 
single  decision  node  multiple-outcome  model  of  decision  making  under  risk. 
Crawford  et  al.  (1978),  Keefer  (1978)  and  Pliskin  el  al.  (1980)  are  among  those 
who  have  considered  applications  of  a  decision  situation  model  of  this  type. 

Our  research  considers  the  following  general  approach  for  aiding  single- 
stage  finite-alternative  multicriteria  decision-making  under  risk.  We  assume 
that  the  structure  of  the  problem  has  been  identified,  and  that  probabilities 
and  value  scores  for  each  objective  criterion  or  attribute  have  been  assessed. 
However,  attribute  aggregation  information,  in  the  form  of  attribute  weights, 
has  not  been  assessed.  We  assume  that  the  assessment  of  weights  to  enable 
attribute  aggregation  information,  the  central  focus  of  this  paper,  is  carried 
out  in  a  three-step  iterative  procedure. 

( 1 )  We  use  various  algorithmic  procedures  to  partially  order  the  alternatives 
into  a  dominance  structure  on  the  basis  of  currently  available  aggrega¬ 
tion  information. 

(2)  If  this  partial  order  provides  enough  information  so  that  an  alternative 
can  be  selected  completely  without  more  specific  alternative  ranking 
information,  then  stop. 

(3)  If  complete  selection  cannot  be  made,  then  assess  further  objectives 
aggregation  information  and  return  to  Step  1. 

We  envisage  three  forms  of  decision  rules  to  enable  judgement  here.  In  a 
holistic  rule,  the  whole  is  disaggregated  into  its  parts,  values  for  the  parts 
are  determined  and  aggregated  to  form  a  single-scale  value  measure.  In 
heuristic  elimination,  alternatives  perceived  as  unacceptable  are  eliminated 
by  use  of  various  conjunctive  or  disjunctive  scanning  approaches,  etc.  In 
wholistic  judgement,  alternative  selection  is  made  on  the  basis  of  reasoning 
by  analogy,  intuitive  affect,  or  other  forms  of  judgement  that  consider  the 
whole  of  a  situation  without  disaggregating  criteria  associated  with  outcomes 
into  various  criteria.  See  Sage  (1981)  for  a  discussion  of  various  decision 
rules  associated  with  these  three  judgement  types. 

Three  basic  dominance  procedures  for  ordering  alternatives  into  a  dominance 
structure  are  considered  here. 

(1)  Expected  value  score  dominance  (EVSD). 

(2)  First  order  stochastic  dominance  (FOSD). 

(3)  Second  order  stochastic  dominance  (SOSD). 

We  remark  that  utilization  of  the  iterative  approach  for  decision  aiding 
suggested  here  allows  the  decision-maker  (DM),  rather  than  a  paradigm,  to 
determine  the  mix  of  holistic  judgement  or  heuristic  elimination  (Step  2),  and 


Multiple  objective  evaluation  and  prioritization 


469 


assessment  of  objectives  aggregation  information  (Step  3).  Support  to  the 
claim  that  this  iterative  procedure  enhances  the  flexibility  and  the  behavioural 
acceptability  of  decision  support  systems  (DSS)  can  be  found  in  White  and 
Sage  (1980)  and  White  el  al.  (1982).  Single-stage  alternative  selection  under 
certainty  is  discussed  in  White  and  Sage  (1980).  The  design,  implementation 
and  partial  evaluation  of  a  microprocessor-based  DSS  based  on  a  single-pass 
version  of  the  above  iterative  procedure  is  reported  in  White  et  al.  (1982). 
The  intent  of  the  DSS  discussed  by  White  et  al.  is  to  provide  a  physician  with 
a  set  of  non-dominated  diagnostic  tests,  determined  on  the  basis  of  cost  and 
expected  information  flow,  in  order  to  aid  in  the  diagnosis  of  a  common 
medical  complaint.  The  set  of  non-dominated  diagnostic  tests  usually  con¬ 
tains  no  more  than  four  tests  from  an  alternative  set  containing  fourteen 
tests.  Physicists  who  have  used  the  DSS  have  found  that  such  a  small 
initial  non-dominated  set  usually  represents  sufficient  support  for  alternative 
selection,  which  in  part  justifies  the  restriction  of  the  above  iterative  procedure 
to  a  single  pass  in  this  decision-making  environment.  An  evaluation  of  the 
aid’s  capability  has  indicated  that  its  use  has  a  significant  beneficial  impact 
on  the  cost  and  the  frequency  of  major  diagnostic  errors.  Perhaps  more 
interestingly,  an  evaluation  of  the  aid’s  acceptability  in  an  operational  (i.e. 
clinical)  environment  has  indicated  a  promising  level  of  user  acceptability, 
relative  to  the  level  of  user  acceptability  usually  experienced  by  other  DSSs 
(Adelman  et  al.  1981,  Sage  and  White  1980). 

We  assume  that  the  objectives  aggregation  information  assessed  represents 
a  global  description  of  the  amount  of  influence  that  two  or  more  lower  (not 
necessarily  lowest)  level  objectives  have  on  a  higher  (not  necessarily  highest) 
level  objective.  In  contrast,  a  complete  scalar  multiattribute  utility  assess¬ 
ment  represents  a  global  description  of  the  amount  of  influence  that  all  lowest 
objectives  have  on  the  highest  level  objective  (Keeney  and  Raiffa,  1976). 
Several  iterations  of  the  aforementioned  three-step  procedure  may  therefore 
be  required  in  order  to  specify  fully  the  DMs  utility  function.  The  suggested 
procedure  does  not,  however,  necessarily  require  a  complete  specification  of 
the  utility  function  to  enable  evaluation  and  prioritization  of  the  alternatives. 
This  may  reduce  the  time  and  stress  associated  with  complete  preference 
information  assessment,  sometimes  considerably.  If  desired,  the  approach 
may  be  continued  so  that  ultimately,  a  completely  specified  scalar  multi- 
attribute  utility  function  is  obtained  such  that  the  dominance  structure  is 
that  of  totally  ordered  alternatives. 

A  similarity  exists  between  this  decision  support  (evaluation)  approach 
and  various  interactive  multiple-objective  optimization  approaches  (e.g. 
Geoffrion  et  al.  1972.  Hwang  et  al.  1980,  Oppenheimer  1978.  Musselman  ami 
Ta lavage  1980,  Zionts  and  Wallenius  1970)  in  that  both  interactively  and 
iteratively  attempt  to  eliminate  clearly  inferior  alternatives  from  further 
consideration.  However,  our  problem  definition  differs  fundamentally  from 
the  problem  formulations  on  which  the  interactive  multiple-objective  optimiza¬ 
tion  procedures  are  based.  Most  of  the  multiple-objective  optimization 
formulations,  such  as  those  cited,  are  deterministic  and  assume  a  non- 
denumerable  set  of  alternatives  and  structural  conditions  which  allow  for 
the  direct  application  of  various  mathematical  programming  procedures. 
Furthermore,  the  interactive  multiple-objective  optimization  procedures  are 
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fundamentally  impact  assessment  and  optimization  procedures  which  most 
appropriately  refine  parameters  within  a  system,  rather  than  evaluate  and 
prioritize  different  policy  alternatives.  Within  the  systems  engineering 
framework  (Sage  1982),  these  are  analysis  and  optimization  procedures, 
whereas  we  present  an  evaluation  and  interpretation  procedure  for  decision 
support. 

Two  important  issues  may  be  posed  as  questions.  These  naturally  arise 
from  our  approach  to  decision  aiding.  Their  resolution  is  the  primary  con¬ 
cern  of  this  paper.  The  two  questions  are  as  follows. 

(1)  Under  what  conditions  will  additional  objectives  or  criteria  aggregation 
information  imply  a  reduction  in  the  number  of  alternatives  requiring 
holistic  or  heuristic  judgement  i 

(2)  Can  the  various  algorithmic  tasks  associated  with  this  approach  be 
carried  out  in  times  compatible  with  interactive  computing  > 

This  first  issue  arises  from  our  perception  that  most  DMs  will  expect  that 
more  effort  devoted  to  the  assessment  of  objectives  aggregation  information 
will  reduce  the  effort  required  for  holistic  judgement  or  heuristic  elimination 
by  reducing  the  number  of  alternatives  that  are  candidates  for  the  most 
preferred  alternative,  and  conversely.  In  fact,  this  expectation  may  not 
always  be  realized.  We  provide  conditions  in  this  paper  which  guarantee 
that  additional  objectives  aggregation  information  implies  increased  alternative 
discrimination  specificity. 

The  second  issue  has  become  of  concern  due  to  the  fact  that  the  SOSD 
relation  often  requires  significant  computational  effort.  In  order  to  reduce 
this  effort,  we  take  advantage  of  the  facts  that  the  FOSD  relation  is  a  lower 
bound  on  the  SOSD  relation  and  that  there  is  a  computationally  attractive 
upper  bound  on  the  SOSD  relation.  We  call  this  upper  bound  the  strong 
SOSD  relation  (SSOSD).  All  of  these  relations  are  transitive. 

This  paper  is  organized  as  follows.  Several  preliminary  definitions  and 
remarks  are  presented  in  the  next  section.  The  EVSD,  FOSD,  SOSD  and 
SSOSD  relations  are  defined  in  §§3-6.  In  §§3  5  we  present  conditions 
which  guarantee  that  additional  objectives  aggregation  information  implies 
increased  alternative  discrimination  specificity.  These  results  resolve  the 
first  issue,  at  least  partially.  In  §  6,  procedures  are  developed  for  reducing 
the  computational  effort  associated  with  the  SOSD  relation,  thus  at  least 
partially  resolving  the  second  issue  concerning  computational  attractiveness. 

3.  Preliminary  definitions  and  remarks 

We  assume  that  the  DM  can  select  for  implementation  any  one  of  /’ 

predetermined  alternatives  from  the  finite  alternative  set  II  ={77-' . rr"}. 

Implementation  of  an  alternative  will  result  in  the  occurrence  of  any  one  of 
.1/  possible  outcomes.  There  are  .V  objectives  associated  with  each  outcome. 
Let  (•„"*  be  the  alternative  independent,  predetermined  value  -store  of  the  with 
outcome  with  respect  to  the  «th  objective.  The  real  number  rnm  is  isotone 
(monotonieally  nun -decreasing)  in  preference  with  respect  to  the  wth  objec¬ 
tive  ;  that  is.  outcome  in'  is  (weakly)  preferred  to  outcome  in  with  respect 
to  objective  11.  if  and  only  if  We  define  the  value  score  vector 
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associated  with  the  with  outcome  *  «  ■"  ■{v1m,  ...,vvm}  and  Jet  V  =  {vm,  m  = 
1,  d/}  be  the  collection  of  all  lulue  score  vectors.  The  probability  that 

outcome  m  will  result  if  alternative  rrp  is  selected  is  the  scalar  n>>(vm).  We 
note  that  rr"  is  equivalently  considered  to  be  a  probability  mass  vector  having 
with  scalar  component  rr"(vm)  ;  i.e.  w"  =  We  remark  that 

alternative  dependent  value  scores  can  be  considered  in  this  framework  by 
properly  expanding  the  outcome  set  and  appropriately  redefining  the  outcome 
probabilities. 

Each  of  the  four  relations,  EVKD.  “FOND,  SOSD  and  SSOSI),  will  be 
described  as  a  subset,  say  R,  of  ordered  pairs  n  x  II.  The  relation  (a-',  rr)eR 
will  be  given  the  interpretation  that  alternative  rr'  is  (weakly)  preferred  to 
alternative  rr  (with  respect  to  R).  The  set  R  of  ordered  pairs  represents  a 
valuable  aid  in  selecting  an  alternative.  The  non-dominated  set  of  R  is 
guaranteed  to  contain  the  most  preferred  alternative.  (Alternative  well  is 
said  to  be  dominated  if  there  is  a  w'efl  such  that  (rr',  rr)eR  and  (rr,  rr')$R. 
The  set  of  all  alternatives  in  n  that  are  not  dominated  is  called  the  non- 
dominated  set  of  R.)  Hence,  search  for  the  most  preferred  alternative  can 
be  confined  to  the  non-dominated  set.  (However,  the  second  most  preferred 
alternative  may  not  be  in  the  non-dominated  set.  This  may  cause  concern 
if  the  objective  of  decision  aiding  is  to  select  the  K  most  preferred  alternatives 
(White  and  Sage  1980).)  More  specifically,  if  there  is  a  w'ell  such  that 
(rr',  ir)eR  for  all  well,  then  rr'  is  an  optimal  alternative.  Additionally,  if 
(rr,rr')^R  for  all  w  except  for  the  case  where  w  =  w',  then  rr'  is  the  unique 
optimal  alternative. 

Throughout,  the  function  /  :  R-v— * RL  will  represent  the  objective  or 
attribute  aggregation  function,  a  functional  representation  of  the  DMs  prefer¬ 
ences.  regarding  value  score  aggregation.  For  example,  we  might  let  L  = 
.Y-2^1,  ft(v)-v,(l  =  1,  ...,  X  -3),  /.v_4(t\_2,  t'.v-L  %)  represent  the  value 
score  for  the  aggregated  attribute  ‘  operating  expenses  ’,  where  vs_2.  uv_, 
and  t’v  represent  the  value  scores  of  the  three  attributes  ‘  fuel  expenses  \ 
‘  scheduled  maintenance  expenses  ",  and  ‘  unscheduled  maintenance  expenses  ‘ 
that,  taken  together,  comprise  the  higher  order  attribute  ‘  operating  expenses  \ 

III  the  next  three  sections,  we  will  examine  the  impact  of  objectives  aggre¬ 
gation  functions  on  the  EV.SD,  FOSD  and  SOSD  relations.  Specifically,  let 
R  and  R  be  any  one  of  these  three  relations  on  II  before  and  after  an  objectives 
aggregation,  respectively.  We  would  generally  hope  and  expect  tha  t  Reft. 
This  is  equivalent  to  the  statement  that  objectives  aggregation  has  provided 
at  least  as  much  alternative  discrimination  specificity  as  there  existed  before 
the  aggregation.  However.  R  does  not  guarantee  that  the  non-dominated 
set  in  II  associated  with  R  is  smaller  than  that  associated  with  R.  Examples 
of  a  non-dominated  set  becoming  larger  following  the  elimination  of  an 
attribute  are  easy  to  construct  but  are  somewhat  pathological  in  practice. 
In  applications,  non-dominated  sets  tend  to  grow  smaller  as  more  preference 
information  is  assessed.  Thus,  from  a  practical  perspective.  7/  £  R  essentially 
supports  resolution  of  the  first  issue  addressed  in  this  paper.  Our  intent, 
therefore,  in  the  following  three  sections  is  to  determine  what  conditions 
imply  that  R^R  for  the  EVS1).  FOND  and  SOSD  relations. 
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4.  Expected-value  score  dominance 

Let  Re  be  the  subset  of  ordered  pairs  in  II  x  II  defined  as  follows  :  (77',  7 r)e/?0 
if  and  only  if  the  vector  relation 

E  vir'(v)$-  £  vn(v) 

vs  V  csV 

is  satisfied.  (Note  that 

n 

£  Vi t(v)  =  vmn(vm) 

vs  V  m  =  1 

where  vmTr(vm)  is  the  A’-vector  having  nth  scalar  element  vnm  n(vm).)  We 
refer  to  Re  as  the  expected- value  score  relation  on  n,  a  relation  which  is 
clearly  transitive.  (The  relation  R  is  transitive  if  and  only  if  (77",  -n')eR  and 
(77',  tr)eR  imply  (77",  77 )eR.)  Note  that  (77',  n)eRe  if  and  only  if  the  expected- 
value  score  associated  with  alternative  77'  is  at  least  as  great  as  the  expected- 
value  score  associated  with  alternative  tt  for  every  objective.  Thus  if  the 
value  score  vector  represents  Von  Neuman  Morgenstern  utility,  then  we 
are  calculating  expected  (vector)  utility.  Our  interest  in  Rc  is  due  to  the 
fact  that  it  represents  the  basis  for  several  operational  decision  aids  (Kelly 
1978).  Let  Re  be  the  expected-value  score  relation  after  an  objectives 
aggregation  ;  that  is,  let  Re  be  such  that  (77',  77 )eRc  if  and  only  if 

E  f(vW(v)>  E  f(v) n(v) 

vs  V  vs  V 

The  following  result  presents  the  relationship  between  Re  and  Re. 

Proposition  1 
If  either 

(a)  f  is  affine  (linear  on  V  plus  a  constant)  and  isotone,  or 

( b )  M  =  2  and  /  is  isotone, 

then  RecRf. 

Under  the  additional  assumption  that  /  is  strictly  isotone,  a  straight¬ 
forward  argument  shows  that  the  aggregation  will  not  cause  the  non-dominated 
set  to  increase.  Linear  objectives  aggregation  represents  a  very  common 
aggregation  procedure  for  operational  decision  aids  (Kelly  1978),  and  is  the 
ultimate  result  of  continuing  the  process  of  obtaining  greater  attribute  aggre¬ 
gation  at  each  iteration. 

Proof 

(a)  Assume  (77',  77 )eRe.  By  the  isotonicity  of  / 

/[Sr«r'(r)l>/fSr«w(r)j 

That  /  is  affine  then  implies  (77',  n)eR,.. 

(b)  Note  that  for  the  ease  where  .1/  =2 

E  ri7'(r)>  V  vtt(v) 

rs  T  re  I' 


is  equivalent  to 


rVU'O-ffO-MISM-'VtrM-Trtr1)] 
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Assume  n'lv1)  -  n{vl)  >  0,  which  implies  v1  >i>2  from  the  foregoing  inequality. 
Xote  that  vl^v2  implies  f(v1)^  f(v2),  which  in  turn  implies 

/0>*)[ttV)  -  ^l)]  >  f(v*)W(v')  -  ir(®1)] 

which  is  equivalent  to  the  desired  result.  The  -  ir(vl)  =  0  case  is  trivial  ; 
the  n'lv1)  —  tt(v1)  <  0  case  proceeds  as  above.  □ 

We  now  present  a  counter-example  to  the  possibility  intuitive  claim  that, 
in  general,  Re^Rf. 


Example  1 

We  consider  a  specific  two-alternative  three-outcome  case  where  there  are 
two  attributes  corresponding  to  each  outcome.  Let 


■o' 

1  1 

T 

1  1 

'0-75' 

II 

II 

<N 

a 

11 

« 

1 

o_ 

0-75 

7r'(e1)  =  0-2,  w'{v2)  =  0-2,  v'(v3)  =0-6 

ir(vl)  =  0-3,  7r(»2)  =  0-3,  7r(t>3)  =  0-4 

We  see  that 


I 

re  V 


Vrr'(v)  - 


0-C5 

0-65 


I 

re  V 


Vjr(v )  — 


0-60 

0-60 


Thus  (tt',  tt )eRr  ;  that  is,  alternative  n'  dominates  n  with  respect  to  the 
EVSD  relation.  This  means  we  can  expect  that  n'  is  preferred  to  n  no  matter 
what  the  relative  weights  of  the  two  attributes. 

Consider  the  case  where  the  aggregation  function  is  the  multilinear  case  : 
f{vl)=klv1i+ktv2i  +  (l  —  i,—  k2)vli  t'2'  for  i  =  1 ,  2  or  3.  A  multilinear  utility 
function  is  a  necessary  condition  for  mutual  utility  independence  ;  see  Keeney 
and  Raiffa  (1970)  for  details.  Xote  that  f(vl)=k2,  f{v2)=kl  and  f(v3)  = 
3(kt  +Lj)/16  +  9/16.  It  follows  that  the  expected  values  of  the  two  alternatives 
are 


£  /(c)tt'(i!)  —  3g(k ,  +  k 2)  +  Si 


I  /<rMr)  =  ?(*,+*,)  + A 

r€  r 

( )bscrvet  hat  if  (k,  +k.,)  ^  9 '.7.  then  (tt'.  n)eR,.  :  however,  when  (kt+k.,)^  9/5. 
(tt .  tt' )e R ,..  Thus  when  the  sum  kt+k,  exceeds  9.5.  objectives  aggregation 
using  the  multilinear  utility  function  does  not  imply  that  A',,  c For  the 
particular  ease  where  the  multilinear  function  is  linear,  we  have  kl+k.,=  1 
and  (77'.  77)6 Rr. 
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Example  2 


We  now  present  a  simple  numerical  example  which  illustrates  the  deter¬ 
mination  of  Rc  and  Re.  Assume  there  are  five  possible  outcomes,  four 
lowest  level  attributes  initially  under  consideration,  and  six  available  alter¬ 
natives,  i.e.  M  —  5,  y  =  4,  P  =  t>.  Table  1  presents  assumed  data,  and  the 
expected  value  scores  are  listed  in  Table  2  (a).  On  the  basis  of  the  informa¬ 
tion  contained  in  Table  2(a),  Re  =  {(1,  3),  (2,  3),  (4,  3)}  and  the  expected- 
value  dominance  digraph  for  the  six  alternatives  is  given  by  Fig.  1. 

Assume  f(v)  =  Av.  where  the  first  three  attributes  are  aggregated  together 
into  a  single  attribute  according  to 


,4  = 


0-1  0i 
0  0 


0-8  0 

0  1 


Table  3  presents  the  value  scores  resulting  from  aggregating  the  value  scores 
of  Table  l  (a)  and  these  weights.  Here,  the  aggregation  function  is  isotone 
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(b)  Alternative 
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0-3 
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Table  1.  Data  for  Example 

o. 

(a)  Value 

scores  v 

for  each 

outcome. 

(b)  Probabilities  for  each  alternative. 

7T"( 

urc  1.  Expected-value  dominance  dijrrapli  for  alternatives  before  aggregation. 
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1 
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Alternative  numbers 

3  4 

5 
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0-75 

0-75 
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0-50 

0-50 

(a)  Attribute 
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0-60 
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0-41 

0-31 

0-18 

0-34 

0-27 

0-37 

.  4 

0-45 
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0-40 
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0-90 

(6)  Attribute  1 

(  1"3 

0-463 

0-393 

0-219 

0-362 

0-276 

0-346 

number  | 

l  4 

0-450 

0-400 

0-400 

0-700 

0-800 

0-900 

Table  2.  Expected- value  scores  for  Example  (2)  :  (a)  before  the  aggregation,  and 

(6)  after  the  aggregation. 


Outcome  number,  m 
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3  4 

5 

Attribute  ( 

0-44 

0-29 

0-85  0 

0-29 

number  j  4 

0-5 

0-5 

0-5  0 

1 

Table  3.  Value  scores  vn'A  for  each  outcome. 


Figure  2.  Expected-value  dominance  digraph  for  alternatives  after  aggregation. 


and  linear  and  the  trade-off  weights  for  the  three  attributes  I.  2  and  3  or  o-l, 
o-l  and  O  S.  respectively.  Table  '2(b)  gives  the  expected-value  scores  after 
the  aggregation,  indicating  that  /?,,=  {(  1 .  2),  (2,  3),  (4.  3),  (0,  5),  5,  3)}.  Note 
that  t ho  aggregation  has  produced  a  noil-dominated  set.  the  set  {1.4.  0}. 
which  is  strictly  smaller  than  the  noil-dominated  set  before  the  aggregation. 
{1,2,  4.  5.0}.  Figure  2  indicates  the  expected-value  dominance  digraph  for 
the  six  alternatives  after  aggregation. 
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5.  First-order  stochastic  dominance 

Let  Ry  be  the  subset  of  ordered  pairs  in  n  x  II  defined  as  follows  :  {tt',  n)eR1 
if  and  only  E(u,  tt')  ^  E(u,  tt)  for  all  ueUv  where  Uy  is  the  set  of  all  real-valued 
functions  on  V  that  are  isotone  and  where 

E(u,  tt)  =  Yj  U(v)tt(v) 

ve  V 


Thus,  E(u,  tt)  is  the  expected  utility  vector  associated  with  utility  function  u 
and  probability  mass  function  tt.  We  refer  to  A,  as  the  first-order  stochastic 
dominance  (FOSD)  relation  on  n,  a  relation  that  is  both  transitive  and  anti¬ 
symmetric  (Fishburn  and  Viekson  1978).  An  equivalent  and  more  opera¬ 
tionally  useful  definition  of  R1  is  as  follows  (Lehmann  1955)  :  (tt',tt)bR1  if 
and  only  if  tt'(K)  ^  tt(  K)  for  all  KeJT  =  {A'  cl':  if  veK,  v'e  V  and  v'  5=  v,  then 
v'eK)  where 


tt(K)=  Y  n(v) 

veK 


■)t  is  the  (finite)  collection  of  all  the  so-called  increasing  sets  in  V. 

Let  =  {A'c  F  :  if  veK,  v'eV  and  f(v')^f(v),  then  v'eK},  the  collection 
of  increasing  sets  after  an  objectives  aggregation.  Define  exactly  as  Rt 
was  defined,  except  replace  Jf"  with  JT.  We  now  present  our  main  result 
involving  objectives  aggregation  for  FOSD. 


Proposition  2 

If  /  is  isotone,  then  R1^Rl, 


Proof 

A  simple  argument  demonstrates  that  which  implies  Ry  = 

directly  from  the  definition.  Q 

We  now  illustrate  Proposition  2  with  the  following  example. 

Example  3 

Consider  the  problem  presented  in  Example  2.  The  data  presented  in 
Table  1  (a)  generate  the  dominance  digraph  of  outcome  state  elements  in  V 
in  Fig.  4.  The  increasing  sets  in  JT  associated  with  this  digraph  which  are 
of  interest  are:  {1},  {3},  {5},  {1,3},  {1,5},  {3,5},  {1,3,5}  and  {1,  2,  3,  5}. 
We  delete  consideration  of  {1,  2.  3,  4,  5}eJT  and  since  7t({1,  2,  3,  4,  5})  =  10 
and  ff(<£)  =  0-0  for  all  wen. 

We  do  not  need  the  cardinal  values  given  in  Table  1  (a)  to  generate  the 
increasing  sets  shown  here.  Any  ordinal  preference  relations  that  imply  the 


Figure  3.  First-order  stochastic  dominance  digraph  for  alternatives  before  attribute 

aggregation. 
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Figure  4.  Domination  digraph  of  Example  3  for  the  v.Jue  scores  associated  with 

Table  1. 


Increasing  Alternative 


INKdE  ■ 

■ill!  ■ 

■Itl 

Table  4.  Probabilities  of  the  increasing  sets  for  each  alternative,  i.e.  P(vsK\n) 
for  each  A'eJT  and  7ren  :  (a)  before  and  (6)  after  the  value  score  aggregation 
in  Example  3. 


outcome  state  domination  digraph  of  Fig.  1  will  suffice.  We  do  use  these 
values  for  aggregation  later  in  this  example,  however. 

The  probabilities  associated  with  each  of  the  above  sets  for  each  alternative 
are  displayed  in  Table  4  (a).  We  note  that  the  only  alternative  pair  (it,.,  ttj) 
for  which  ■ni{K)^-rrj(K)  for  all  Ke.)f  is  the  pair  t'  =  4,  j  =  3.  Thus,  it  follows 
that  y?,  =  {(4,  3)},  and  hence  for  this  example  Figure  3  illustrates 

the  FOSI)  relation  among  alternatives  before  an  attribute  tradeoff.  There 
will  generally  be  1  less  dominance  ’  associated  with  FOSD  than  EVNI). 
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As  in  Example  2,  let  /  be  linear  and  assume  the  value  scores  for  attributes 
1,  2  and  3  are  traded-off  with  weights  0-1,  0-1  and  0-8,  respectively.  Again, 
this  results  in  the  value  score  matrix  given  in  Table  3.  The  resulting  domin¬ 
ance  digraph  of  output  state  elements  in  V  is  given  in  Fig.  5.  This  digraph 
has  the  following  increasing  sets  of  interest :  {3},  {5},  {3,  5},  {1,  3},  {1,  3,  5} 
and  {1,  2,  3,  a}.  Notice  that  the  total  number  of  increasing  sets  has  been 
reduced  by  the  aggregation.  Table  4  (b)  presents  the  probabilities  associated 
with  these  increasing  sets.  It  then  follows  that  ^  =  {(1,2),  (4,3),  (6,5)}, 
which  provides  more  preference  information  with  respect  to  the  alternatives 
than  does  Rv  Again  we  see  that  there  is  less  preference  information  given 
by  FOSD  than  by  EVSD.  Thus  Rl  c  Re.  Figure  6  shows  the  FOSD  digraph 
for  the  six  alternatives  of  this  example. 


Figure  5.  Output  state  value  domination  digraph  for  the  value  scores  associated 
with  Table  3  after  the  value  score  aggregation  for  Example  3. 


Figure  6.  First-order  stochasticdominanceofalternativesafterattribute aggregation. 

It  is  of  interest  to  give  conditions  that  relate  the  two  orders  Rr  and  I?,. 
Let  the  function  IK  :  F— ►  {(),  1}  be  such  that  /K(v)=  1  if  veK  and  I K( v)  =  0 
if  v$K.  Let  /  =  {'/A-}K-ejr.  Thus,  l(v)  is  a  y-vector,  if  Of  contains  y  subsets 
of  F,  which  identifies  the  increasing  sets  containing  v.  It  is  easy  to  demon¬ 
strate  that  (jt\  7 r)ei?1  is  equivalent  to 

It  is  now  straightforward  to  show  that  the  following  results  hold. 

Proposition  3 

(u)  Assume  there  is  an  isotone,  affine  function  a  such  that  x|/(r)J  =  r  for 
all  re  V.  Then  Rt  s  Rc. 

(b)  Assume  there  is  an  isotone,  affine  function  /?  such  that  /}(»)  = /(r)  for 
all  re  V.  Then  R,,cRv 

We  now  illustrate  Proposition  3  with  the  following  example. 


r 

t  • 
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Example  4 

Consider  the  data  presented  in  Tables  1  («)  and  4  (a).  With  reference  to 
Table  4(a),  note  that  /(al)  =  col  {1,  0,  0,  1,  1,  0,  1,  1},  in  that  le{  1 },  1<*{3}, 

1£{5},  le{l,  3),  and  so  forth.  The  collection  of  column  vectors  {/(a1) . 

/(a/)}  is  then 

'1  0  0  0  O' 

0  0  10  0 
0  0  0  0  1 

10  10  0 

[/(a1),  ...,f(t>5)]  = 

10  0  0  l 
0  0  !  0  I 

10  10  1 
I  I  10  1 

In  order  to  illustrate  Proposition  3  (a),  we  seek  an  isotone,  affine  function  n 
such  that 


[a1 . a5]  =  a|7(al) . /(a5)] 


where,  from  Table  1  (a) 


'  l 

0-5 

0-5 

0 

1 

0 

0 

0 

[a*.  .. 

..  a5]  = 

• 

0-3 

0-3 

1 

0 

0-5 

0-5 

0-5 

0 

Note  that  since  a4  =  «/(a4),  a  is  required  to  be  linear,  i.e.  a  is  a  4  x  8  matrix. 
We  can  now  omit  a4  and  /(a4)  from  further  consideration.  Standard  algebraic 
procedures  show  that 

'0-;j  0  0  0  0  0  0  0-5' 

1  0  0  0  0  0  0  0 

x  = 

0  0-7  o  0  0  0  0  0-3 

0  0  0*5  o  O  0  0  (»•/> 

is  such  that  *[/(»•)]  =a  for  all  re  I’.  We  remark  that  «  is  not  unique  and  that 
other  a  can  be  found  which  are  linear  and  satisfy  x(/(r)|  =  e  but  are  not 
isotone.  Clearly  a  is  isotone,  and  lienee  from  Proposition  3(a).  U,  S 
which  is  verified  by  the  results  in  Examples  2  and  3.  Since  the  aggregation 


M 


*  *.  • 

'•»_  wr'J 
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function  used  was  linear  in  both  Examples  2  and  3,  it  is  straightforward  to 
show  that  Rt  c  Ret  using  Proposition  3  (a)  and  the  same  a  as  above. 

Straightforward  algebraic  manipulation  shows  that  there  exists  a  unique 
8x4  matrix  ft  such  that  /to  =  I(v)  for  all  ve  V,  where 


'  0 

1/10 

0 

0 

-3/35 

3/70 

1/7 

0 

-1/5 

1/10 

ft 

1/5 

-3/35 

1/7 

1/7 

0 

-1/5 

1/5 

ft 

1/5 

-2/7 

1/7 

1/7 

1/5 

-2/7 

i 

17/70 

1/7 

1/5 

L  1/5 

-  1/10 

ft 

0 

Note,  however,  that  /}  is  not  isotone  and  thus  it  does  not  necessarily  follow 
from  Proposition  3(b)  that  ResRy.  In  fact,  we  observe  from  Examples  2 
and  3  that  RezRy  does  not  hold. 

In  concluding  this  section,  we  present  two  facts  that  have  potential 
computational  impact  for  determining  Rv  Let  =  (A'eJf :  A'leJ»  }, 
2  =  Jf  [C,  where  J f,c  is  the  complement  of  Jf  ,.  It  is  interesting  to  note 
that  tt’(K)  =  tt(K)  for  all  A'eJT,  if  and  only  if  (it',  ir)e Ry.  This  fact  suggests 
that  in  trying  to  determine  whether  or  not  (tt',  w)e/f,  a  simple  initial  check 
would  be  to  see  if  7r'(A')  =  n(K)  for  all  A'eJf',.  We  observe  that  only  half  of 
the  ■?fr1  sets  need  to  be  checked  since  n'(K)  =  n(K)  iff  tt'(K')=tt(Kc),  thus 
reducing  the  computational  burden  of  checking  all  of  the  sets  in  JT,.  It 
can  easily  be  shown  that  if  all  elements  in  the  outcome  set  are  non-dominated, 
i.e.  Jf  =  Jft,  then  all  elements  in  11  are  non-dominated  ;  thus,  if  all  elements 
in  the  outcome  set  are  non-dominated,  it  is  unnecessary  to  determine  the 
relaticn  on  the  alternative  set. 


6.  Second-order  stochastic  dominance 

Let  R2  be  the  subset  of  ordered  pairs  in  11  x  11  defined  as  follows  :  (tt',  tt)€R2 
if  and  only  if  E(u,  v')^  E(u,  n)  for  all  uet'.,,  where  (\  is  the  set  of  all  real¬ 
valued  functions  on  1’  that  are  both  isotone  and  concave.  We  refer  to  R., 
as  the  second-order  stochastic  dominance  (SOSD)  relation  on  II.  The  con¬ 
cavity  of  a  utility  function  is  the  functional  representation  of  global  risk 
aversion,  describing  the  preference  structure  of  a  decision-maker  who  will 
never  invest  in  an  actuarially  fair  prospect. 

Fishbtirn  and  Vickson  (1978)  have  presented  a  slightly  less  general  version 
of  the  following  necessary  and  sufficient  conditions  for  (tt' .  tt)€R.,  :  (tt' .  n)eR2 
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if  and  only  if  there  exists  a  feasible  solution  to  the  following  set  of  linear 
equalities  and  inequalities 


(i) 

o 

A\ 

> 

•xf 

for  all  i,j  =  1, 

...,M 

(ii) 

ii 

-tT 

for  all  i=  1,  .. 

.,  M 

such  that 

(Hi) 

il 

n(v>)=  £  n'iv^dij 
*-  1 

for  all  j  =  1 , 

„M 

(iv) 

M 

£  dijV 

for  all  t  —  1 ,  . . 

.,  M 

j»i 


such  that  7r'(t>*)#0  and  all  n=  1,  AT,  where  vj  is  the  nth  scalar 
entry  of  v>eV  ;  i.e.  v>  =  (ty,  vvJ}. 

Interpretations  of  the  solution  {di;}  to  the  above  can  be  found  in  Fishburn 
and  Vickson  (1978).  To  proceed,  it  is  desirable  to  determine  conditions  under 
which  R2  c  R2.  We  define  R2  as  R2  was  defined,  except  replace  II 2  with  U 2, 
where 

Dl  =  {tt  :  u  is  isotone  on  /(R-v)} 

02=  {ueUl  :  u  is  concave  on  /(R-v)} 

We  now  present  the  conditions  on  /  which  insure  R2  c  R2. 

Proposition  4 

If  we  assume  that  objectives  aggregation  function  /  satisfies  the  following 
conditions 

.v 

(1)  / ,{V>)=  £  vj  6„(  where 

n  =  1 

for  all  7i  =  1 ,  . . . ,  X  and  1=1,  L 

(2)  if  vi=^vi,  then  /(e*)^(t^) 
then  R2^R2. 

Proof 

We  wish  to  show  that  if  (iv)  holds,  then 

j  =  1 

for  all  t  =  l . M  such  that  7r'(t’i)^b  and  all  1=1 . A.  Condition  (2) 

implies  that  the  number  of  v‘  such  that  ir'(v‘)  ^  0  does  not  change  after  the 
aggregation  is  performed.  Condition  (1)  can  be  used  to  show  easily  that  (iv) 
implies  the  above  inequality.  £j 
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We  remark  that  R ,  is  both  transitive  and  antisymmetric  and  that  R1  £  R2 
(Fishburn  and  Vickson  1978).  The  following  example  illustrates  the  latter 
fact  and  Proposition  4. 

Example  5 

Again  consider  the  problem  presented  in  Example  2,  using  second-order 
stochastic  dominance  as  the  method  of  generating  a  partial  order  on  l.  It 
follows  from  application  of  the  results  of  conditions  (i)  to  (iv)  that  R2  = 
{(1,  3),  (4,3)}  and  R2={(1,  2),  (2,  3),  (4,  3),  (6,  5),  (5,  3)}.  Note  that  by  tran¬ 
sitivity  (1,3)  and  (6,  3)  are  members  of  R2.  Note  also  that  it  is  only  coin¬ 
cidental  that  R2=  Rc.  We  observe  that  the  assumption  of  risk  aversion 
has  caused  the  relationship  if,  c:  R2  to  be  strict  both  before  the  aggregation 
and  after  the  aggregation.  Figure  7  illustrates  the  second-order  stochastic 
dominance  before  and  after  the  aggregation  of  the  first  three  attributes,  with 
weights  (0*1.  0-1.  0-8)  into  a  single  attribute. 


a)  BEFORE  ATTRIBUTE  AGGREGATION 


b)  AFTER  ATTRIBUTE  AGGREGATION 

Figure  7.  Second-order  stochastic  digraphs  of  alternatives  for  Example  5. 


7.  Strong  second-order  stochastic  dominance 

We  observe  that  determining  R,  requires  formulating  and  determining  the 
feasibility  of  P(P  —  I)  linear  programs,  each  having  up  to  M(M  +  X  +  '2) 
decision  variables  (2.1/  of  which  are  artificial  variables)  and  up  to  .l/(.Y  +  2) 
side  constraints.  Of  course,  these  computational  requirements  may  be 
decreased  if  the  transitivity  of  //,.  and 'or  the  fact  that  R^cR.,  are  efficiently 
utilized.  Our  experience  indicates,  however,  that  for  even  modestly  sized 
problems  where  card  (//,), card  (II  x  II)  is  relatively  small  (which  is  common), 
determination  of  //,  often  generates  computer  times  that  are  unacceptably 
large  for  interactive  computing.  (Card  .1  is  the  cardinality  of  the  set  .1  : 


A 
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i.e.  the  number  of  elements  in  the  set  A  if  ^4  is  finite.)  For  such  cases,  it 
would  be  useful  to  have  an  easily  computed  upper  bound  on  Rr  We  now 
investigate  one  such  upper  bound. 

Let  Rsn  be  the  subset  of  ordered  pairs  in  rixll  defined  as  follows  : 
(«■',  n)eRsn  if  and  only  if  E(u,  ir')^  E(u,  n)  for  all  ueUsn,  where  Usn  is  the 
set  of  all  real-valued  functions  on  Vn  =  {vnm,  m=\,  M)  that  are  both 
isotone  and  concave.  Thus  Rsn  is  equivalent  to  when  only  the  nth 
objective  is  under  consideration,  and  hence  Rt^Rsn  for  all  n=  1,  ...,  N.  Let 

*s=h  ^s" 

n  *  1 

and  call  Rs  the  strong  second-order  stochastic  dominance  (SSOSD)  relation. 
Since  each  Rsn  is  transitive  and  antisymmetric  for  all  n,  then  so  is  Rs. 
Clearly,  R 2  £  Rs.  We  remark  that  determining  whether  or  not  (n\  i r)eRs 
is  equivalent  to  at  most  A’  separate  checks  for  univariate  second-order 
stochastic  dominance,  for  which  there  exists  a  computationally  simple  pro¬ 
cedure  (cf.  §2.14  in  Fishburn  and  Vickson  (1978)).  We  describe  this 
procedure  as  follows.  Assume  for  notational  convenience  that  for  objective 
n,  m'^rn  implies  vnm  ^vnm  ;  i.e.  with  respect  to  objective  n,  outcome  m+  1 

is  at  least  as  preferred  as  outcome  m,  for  m  =  1 . M—  1.  Then  (n-'.  ir)eRsn 

if  and  only  if 

(V+,-V)«  I  £  w(vJ)J  {v*M-vnl) 

for  all  /=  1,  ...,  M—  1. 

We  also  note  that  under  certain  independence  conditions  (presented,  for 
example,  in  Theorem  2.11  of  Fishburn  and  Vickson  (1978)),  R2  =  Rs.  We 
now  present  an  example  illustrating  the  computational  usefulness  of  Rs. 


Example  6 

We  again  consider  the  problem  presented  in  Example  2.  Recall  that 

=  {(4,  3)}.  Calculations  based  on  procedures  suggested  in  §  2.14  of  Fishburn 
and  Vickson  (1978)  show  that  RH—  {(1,  3),  (2,  3),  (4,  3)}.  Thus  it  is  only 
necessary  to  check  the  pairs  (1,3)  and  (2,  3)  in  order  to  determine  R2.  Solu¬ 
tion  of  the  two  associated  linear  programs  indicates  that  ( 1 , 3 )ei?2  and 
(2,  3)eRz,  and  hence  i?2  =  i?,<J(l,  3)  =  {(1,  3),  (4,  3)},  which  is.  of  course,  in 
agreement  with  the  results  of  Example  5. 

Calculations  show  that  Rs  =  {(1,  2),  (2,  3),  (4,  3),  (6,  3),  (5,  3)}.  Recalling 
that  /?,  =  {(!.  2),  (4,  3),  (<i,  3)},  the  only  pairs  that  require  examination  are  : 
(2.  2),  (3,3).  The  pairs  (1,3)  and  (0,3)  are  members  of  /7.s  by  transitivity. 
We  observe  that  if  (2.  3 )e R.,  and  (0,  3 )eR.,.  then  it  is  not  necessary  to  check 
if  ( I,  3)e/7,  and  (3.  3)6/7.,.  respectively,  because  of  the  transitivity  of  If.,. 
Solution  of  the  associated  linear  programs  shows  that  (1,3)  and  (0,3)  arc 
members  of  /?3.  We  have  therefore  determined  that  R.,  =  Rs  by  formulating 
and  solving  only  two  linear  programs.  Dominance  digraphs  for  the  SOS I) 
relation  are  presented  in  Fig.  7. 


8.  Conclusions 

We  have  addressed  two  important  issues  that  arise  in  the  application  of 
stochastic  dominance  concepts  to  interactive  decision  support  with  a  single- 
stage  finite-alternative  multicriteria  decision-under-risk  model.  The  key 
characteristics  of  this  approach  are  that  the  DM,  rather  than  the  paradigm, 
is  allowed  to  select  iteratively  and  interactively  a  mix  of  wholistic  judgement, 
heuristic  elimination,  and  holistic  evaluation  of  partial  preference  information 
to  enable  aggregation  of  some  but  not  necessarily  all  criteria  or  attributes. 
Conditions  on  the  attribute  aggregation  function  were  given  which  guarantee 
that  preference  information  supplied  by  the  DM  in  the  form  of  attribute- 
value  score  aggregations  is  transmitted  to  the  relation  on  the  alternative  set 
in  the  form  of  a  stronger  partial  order  for  three  important  relations  :  expected- 
value  stochastic  dominance,  first-order  stochastic  dominance,  and  second-order 
stochastic  dominance.  A  fourth  relation  was  introduced  to  reduce  the  compu¬ 
tational  burden  that  is  often  associated  with  the  determination  of  the  second- 
order  stochastic  dominance  relation. 

With  respect  to  the  interactive  decision  support  approach  outlined  in  the 
Introduction,  the  behavioural  impacts  of  the  results  obtained  here  are  as 
follows. 

(1)  Under  weak  conditions,  more  effort  devoted  by  the  DM  to  the  assess¬ 
ment  of  objectives  aggregation  information  will  result  in  a  reduction 
of  effort  by  the  DM  required  to  obtain  a  rational  dominance  structure 
of  alternative  prioritization  that  is  suitable  for  wholistic  judgement. 

(2)  There  is  a  computationally  attractive  upper  bound  on  the  SOSD 
relation  which  enhances  our  ability  to  obtain  approximate  and  useful 
SOSD  results  in  a  timely  manner  that  is  consistent  with  interactive 
decision  support. 

It  is  of  interest  to  observe  that  the  expected-value  score  relation  and  the 
stochastic  dominance  relations  differ  fundamentally  in  their  interpretation 
of  a  complete-value  score  aggregation,  i.e.  for  the  case  where  the  aggregation 
function  /  :  R-v— *R1  (the  L=  1  case).  In  this  case,  Rf  is  a  linear  order  and 
Rt  and  Rs  may  only  be  partial  orders.  Re  essentially  treats  f(v)  as  a  utility 
function,  i.e.  u(x)  —f[v(x)],  whereas  Rx  and  R2  assume  there  exists  a  still 
unassessed  function  U  which,  when  composed  with  /( v),  produces  the  desired 
utility  function,  i.e.  u(x)  =  l’[/[v(x)]].  A  discussion  of  the  usefulness  of 
assuming  the  existence  of  such  a  function  especially  for  modelling  risk, 
can  be  found  in  Bodily  (1980). 
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Abstract 

We  summarize  key  features  of  an  interactive  plan¬ 
ning  and  decision  support  process  for  multiple  criteria 
alternative  selection  situations.  Probabilities , 
utility  scores  for  the  lowest  level  attributes,  and 
attribute  tradeoff  weights,  i.e.,  the  parameters,  can 
be  imprecisely  described  by  set  inclusion.  Within  a 
specified  structural  model  of  the  decision  situation, 
the  process  allows  the  decisionmaker  to  iteratively 
select  the  mix  of  parameter  value  precision  and  alter¬ 
native  ranking  specificity.  By  selecting  this  mix,  the 
decisionmaker  is  able  to  direct  the  alternative  selec¬ 
tion  process  in  an  interactive  manner,  using  alterna¬ 
tive  selection  strategies  based  on  behaviorally  mean¬ 
ingful  dominance  search  strategies.  Emphasis  is  placed 
on  the  motivation  of  the  research  and  the  behavioral 
relevance  of  the  support  process. 

1.  Introduction 

The  process  of  choosing  among  multiattributed 
alternatives  often  involves  an  initial  search  for  a 
dominance  structure  and  ultimate  identification  of  a 
set  of  nondominated  alternatives.  By  definition,  a 
nondominant  alternative  is  one  which  is  not  worse  than 
any  other  alternative  on  any  attribute  and  which  is 
better  than  each  other  alternative  on  at  least  one 
attribute.  In  most  decision  situations,  however,  there 
is  no  single  alternative  that  dominates  all  other 
alternatives,  at  least  initially.  In  such  decision 
situations,  the  decisionmaker  typically  "adjusts"  the 
structure  of  the  decision  situation,  and  parameter 
values  within  this  structure,  so  as  to  identify  a 
dominance  structure  which  contains  a  single  nondominant 
alternative.  This  search  may  involve  rational  activi¬ 
ties,  such  as  aggregation  of  attributes  and  comper *a- 
tory  tradeoffs  through  determination  of  judgmental 
weights.  Alternately,  it  may  involve  various  rules 
which  may  be  quite  flawed.  Examples  of  such  rules  are 

(i)  lexicographic  ordering,  in  which  the  best  alter¬ 
native  on  the  most  important  attribute  is  selected,  and 

(ii)  sequential  pairwise  comparison  of  alternatives 
using  a  preference  relation  that  is  a  function  of  the 
two  alternatives  being  compared.  In  this  latter  case, 
nontransitive  preferences  may  easily  result  due  to  the 
fact  that  the  contextual  relation  used  to  determine 
preferences  changes  from  binary  comparison  to  binary 
comparison . 

A  variety  of  holistic,  heuristic,  and  vholistic 
judgmental  activities  will  typically  he  involved  m  the 
search  for  a  dominance  structure  among  the  alterna¬ 
tives.  These  take  on  various  forms  and  mixtures  of 
formal  knowledge  based,  rule  based  or  skill  based 
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activities  as  deemed  appropriate  for  the  task  at 
hand  (1,2).  Especially  when  there  are  a  large  number 
of  alternative  courses  of  action  under  consideration, 
the  decision  process  will  typically  involve  mixed 
scanning,  where  some  noncompensatory  rule  is  first  used 
to  eliminate  grossly  inappropriate  alternatives.  This 
is  then  followed  by  one  or  more  compensatory  informa¬ 
tion  evaluation  operations  that  results  in  a  dominance 
structure  which  enables  final  judgment  and  alternative 
selection. 

The  research  discussed  here  is  based  upon  the 
hypothesis  that  people  are  able  to  evaluate  alternative 
plans  and  decisions  efficiently  and  effectively,  and 
with  low  stress,  when  there  is  a  clear  dominance  pat¬ 
tern  among  alternatives  that  enables  establishment  of  a 
sufficiently  discriminatory  priority  structure.  Our 
goal  is  to  provide  a  knowledge  based  decision  support 
process  that  enhances  the  quality  of  the  dominance 
structure  used  for  judgment  and  choice. 

The  next  section  will  present  a  summary  discussion 
of  the  Features  and  structural  constructs  of  our  deci¬ 
sion  support  system.  The  following  section  presents  a 
more  detailed  discussion  of  these  structural  constructs 
and  introduces  some  of  the  modes  in  which  the  support 
process  can  be  used.  Then  we  discuss  some  behavioral 
issues  that  relate  to  the  conceptual  design  of  ARIADNE. 
The  list  of  references  contains  citations  to  a  number 
of  works  which  discuss  the  algorithmic  content  of  the 
decision  support  system. 

2 .  Features  of  the  Decision  Support  System 

We  now  investigate  concepts  for  the  design  and 
evaluation  of  an  interactive  knowledge  based  planning 
and  decision  support  system  which  combines,  or  allows 
combination  of,  several  evaluation  rules  and  contin¬ 
gency  structures  often  used  as  a  basis  for  evaluation, 
prioritization,  judgment,  and  choice.  We  have  de¬ 
veloped  a  knowledge  based  system  to  interactively  aio 
planning  and  decision  support  processes  through  en¬ 
couragement  of  search  for  a  dominance  structure  that  is 
behaviorally  realistic  and  rational,  from  both  ’•  sub¬ 
stantive  and  procedural  viewpoint.  The  suppert  system 
is  called  ARIADNE  for  Alternative  Ranking  Interactive 
Aid  based  on  DomiNance  structural  information  Elicita¬ 
tion.  The  support  system  enables  use  of  various  inte¬ 
grated  forms  of  wholistic,  heuristic,  and  holistic 
reasoning  in  an  aided  search  for  dominance  information 
among  identified  alternatives.  We  believe  it  to  be 
flexible  enough  to  closely  match  diverse  decision 
situations  and  environments  in  order  to  support  varying 
cognitive  skills  and  derision  stylos,  thereby  enabling 
planners  and  decision  makers  to  adapt  its  use  to  their 
own  cognitive  skills,  decision  styles,  and  knowledge. 

Our  efforts  have  concerned  choice  making  situa¬ 
tions  under  certainty  and  unde*  risk,  primarily  for  the 
single  decision  node  case.  This  formulation  allows 


consideration  of  a  variety  of  imprecisely  known  param¬ 
eters  such  as:  attribute  tradeoff  weights,  outcome 
state  values  on  lowest  level  attributes,  event  outcome 
probabilities,  and  various  combinations  of  these. 
Parameter  needs  are  determined  from  the  structure  of 
the  decision  situa  tion,  as  elicited  from  the  decision¬ 
maker  during  the  formulation  and  analysis  stens  of  the 
decision  support  process.  We  consider  these  farmula- 
tion  and  analysis  steps  to  be  outside  the  scope  of  our 
present  software  developments  but  recognize  the  essen¬ 
tial  need  for  them  in  a  complete  decision  support 
process . 

The  decision  situation  structural  model  may  repre¬ 
sent  decisions  under  risk  or  under  certainty.  The 
attribute  tree  representing  the  features  of  decision 
outcome  states  may  be  structured  and/or  parameterized 
in  a  top-down  or  bottom-up  fashion  through  use  of 
ARIADNE.  A  single  level  structure  or  a  multiple  level 
hierarchical  structure  of  attributes  may  be  used  with 
the  choice  of  these  being  at  the  discretion  of  the 
decisionmaker.  Multiple  decision  node  situations  may 
be  approached  through  a  goal  directed  decision  struc¬ 
turing  approach  in  which  the  growth  of  the  structure  of 
alternative  decisions  and  event  outcomes  is  guided  by 
sensitivity-like  computations  obtained  through  use  of 
the  ARIADNE  algorithms  (3-5]. 

Parameters  are  elicited  from  the  decisionmaker  in 
the  form  of  equalities  and  inequality  bounds.  A  var¬ 
iety  of  mathematical  programming  approaches  and  graph 
theory,  have  been  used  to  generate  interactive  displays 
of  preference  digraphs.  These  mathematical  programming 
approaches  are  used  to  determine  dominance  structures 
for  alternative  prioritization  that  are  based  on  para¬ 
meter  information  elicited  from  the  decisionmaker.  At 
present,  only  a  linear  programming  approach  will  yield 
necessary  and  sufficient  conditions  for  determination 
of  a  priority  structure  and  computational  times  that 
are  consistent  with  interactive  decision  aiding.  This 
requires  that  we  elicit  structural  parameter  infor¬ 
mation  in  a  slightly  restricted  form  which  we  denote 
the  "behaviorally  consistent  information  set"  (BCIS). 
Often  this  BCIS  will  be  in  such  a  form  that  solution  of 
the  generally  nonlinear  programming  problems  associated 
with  determination  of  dominance  structures  can  be 
replaced  by  the  solution  of  simple,  computationally 
amenable  linear  programs  with  bounded  variables.  The 
major  simplification  associated  with  eliciting  param¬ 
eter  imprecision  in  a  prespecified  structural  format, 
however,  is  in  the  natural  language  dialogue  needed  to 
establish  a  model  of  the  decision  situation. 

The  purpose  of  the  graph  theory  algorithms  is  to 
enable  construction  of  a  domination  digraph,  or  dom¬ 
inance  structural  model.  This  digraph  is  a  pictorial 
representation  of  the  ordinal  preferences  as  determined 
from  a  dominance  reachability  matrix.  This  matrix  is 
determined  by  the  linear  programming  algorithms  from 
the  decision  situation  structural  model  and  parameters 
elicited  from  the  decisionmaker.  These  domination 
digraphs  encourage  either  selection  of  a  preferred 
alternative,  or  further  iteration  using  the  aggregated 
preference  information  for  feedback  learning. 

An  inverse  aiding  feature  is  currently  being 
incorporated  into  the  decision  support  system  (6,7 |. 
This  feature  allows  the  decisionmaker  to  make  whol- 
lstic,  skill  based  prioritizations  among  alternatives. 
These  prioritizations  may  he  across  some,  or  all, 
identified  alternatives,  at  the  top  level  of  the  hier¬ 
archy  of  attributes  or  at  some  intermediate  level.  If 
we  elicit  numerical  bounds  or,  the  attribute  scores  fr>r 
those  attributes  which  are  subordinate  to  and  included 
within  the  attribute  at  which  alternatives  are  prior¬ 


itized,  then  bounds  on  attribute  weights,  consistent 
with  the  wholistic  prioritization,  may  be  determined  by 
using  a  linear  programming  approach.  Alternately,  if 
weights  are  specified,  then  it  is  possible  to  determine 
bounds  on  alternative  scores  on  those  attributes  subor¬ 
dinate  to  the  attribute  at  which  prioritization  was 
made  through  use  of  linear  programming  algorithms. 

As  alternatives  are  identified  and  prioritized, 
updates  on  these  bounds  are  made  available.  The  re¬ 
sults  obtained  from  using  the  inverse  aiding  feature 
are,  in  many  ways,  comparable  to  those  obtained  from 
the  regression  analysis  based  Social  Judgement  Theory 
(8] .  This  approach  provides  weight  identification 
only,  with  a  "confidence"  measurement  concerning  the 
validity  of  weights,  cardinal  preferences  are  assumed. 
Results  in  the  form  of  bounds  on,  or  ranges  of,  weights 
are  available  with  a  very  few  alternative  prioriti¬ 
zations  in  the  inverse  aiding  approach.  The  prior¬ 
itizations  needed  may  involve  a  mixture  of  cardinal  and 
ordinal  preferences.  For  a  large  number  of  prioriti¬ 
zations,  the  inverse  aiding  approach  may  become  cum¬ 
bersome  computationally  compared  to  the  regression 
based  approach,  where  additional  information  may  be 
easily  proc  ased  in  a  sequential  fashion. 

Combination  of  inverse  and  direct  aiding  to  en¬ 
hance  decisionmaker  specification  of  imprecise  values, 
weights,  and  probabilities  enhances  the  usefulness  of 
ARIADNE  since  it  allows  for  judgments  and  their  expla¬ 
nation,  using  a  combination  of  formal  knowledge  based 
and  skill  based  modes.  This  enhanced  usefulness  will 
also  occur  through  encouragement  to  the  decisionmaker 
to  become  more  aware  of  relevant  alternative  courses  of 
action  and  to  identify  new  alternatives  on  the  basis  of 
feedback  learning  of  the  impacts  of  alternatives  upon 
issues  and  objectives  in  a  behaviorally  relevant  way 
that,  hopefully,  encourages  "double-loop  learning"  (9]. 

3.  Structure  of  ARIADNE 

A  complete  set  of  activities  envisioned  in  using 
the  single  stage,  or  single  decision  node,  version  of 
ARIADNE  involves  the  following  set  of  activities. 

Formulation  of  the  Decision  Situation 

1.  Define  the  problem  or  issue  that  requires  planning 
and  decisionmaking  by  identif icat ion  of  its  ele¬ 
ments  in  terms  of 

(a)  Needs,  and 

(b)  Constraints  or  bounds  on  the  issue. 

2.  Identify  a  value  system  with  which  to  evaluate 

alternative  courses  of  action,  and  identify  ob¬ 
jectives  or  attributes  of  the  outcomes  of  possible 
decisions  or  alternative  courses  of  action. 

3.  Identify  possible  alternative  courses  of  action, 
or  option  generation. 

Analysis  of  the  Decision  Situation 

1.  Determine  outcome  scenarios. 

2.  Identify  decision  structural  model  elements,  that 

is  those  elements  or  factors  from  the  conceptual 
formulation  framework  which  appear  pertinent  for 
incorporation  into  a  decision  situation  structural 
mode  1 . 


3. 


Structure  decision  model  elements: 


step  1  of  the  Evaluation  and  Interpretation 
(C) .  There  exists  many  possibilities  for 
obtaining  greater  alternative  evaluation 
specificity  such  as: 

(i)  setting  higher  aspiration  levels  or 
aspects , 


(a)  Structure  decision  tree, 

(b)  Structure  information  acquisition  and  pro¬ 
cessing  tree--which  may  be  part  of  the  basic 
decision  tree,  and 

(c)  Structure  attribute  tree  or  objectives  hier¬ 
archy. 

4.  Determine  independence  conditions  among  elements 
of  the  attribute  tree  and  decision  alternatives. 

5.  Identify  potential  for  the  use  of  deficient  infor¬ 
mation  processing  heuristics  and  provide  appro¬ 
priate  debiasing  procedures. 

6.  Determine  impacts  of,  or  outcomes  thay  may  result 
from,  alternative  courses  of  action. 

7.  Encode  uncertainty  elements  in  the  form  of  event 
outcome  probabilities,  or  bounds  on  these,  to  the 
extent  possible. 

8.  Identify  risk  aversion  coefficients,  if  needed,  to 
the  extent  possible. 

9.  Identify  preference  or  value  functions,  or  bounds 
on  these  functions,  to  the  extent  possible. 

10.  Identify  attribute  weights,  or  bounds  on  these 
functions,  to  the  extent  possible. 

11.  Identify  wholistic  preferences  among  alternatives 
to  the  extent  that  this  is  possible. 

12.  Identify  possible  disjunctive  and  conjuctive 
aspects,  or  thresholds  for  attributes,  of  iden¬ 
tified  alternative  courses  of  action. 

Evaluation  and  Interpretation  of  the  Outcome  of  Alter¬ 
native  Courses  of  Action 

1.  Identify  a  decision  aiding  protocol,  or  plan,  for 
evaluation  and  interpretation  of  the  decision 
situation. 

2.  Identify  potential  for  use  of  deficient  judgment 
heuristics . 

3.  Use  conjunctive  and/or  disjunctive  scanning  to 
eliminate  very  deficient  alternatives  and  retain 
alternatives  meeting  minimum  acceptability  cri¬ 
teria  across  attributes. 

4.  Determine  the  maximum  amount  of  domination  infor¬ 
mation  possible: 

(a)  Display  domination  digraph. 

(b)  Identify  alternative  courses  of  action  which 
could  not  be  among  the  N  most  preferred 
alternatives.  Normally  these  are  deleted 
from  further  consideration. 

(c)  If  the  decisionmaker  can  select  an  alterna¬ 
tive  for  imp lemeutat i on  by  wholistic  judg¬ 
ment,  or  prioritize  the  remaining  alternative 
set  through  heuristic  elimination,  then  go  to 
step  6  of  E/al'iation  and  Interpretation. 

Id)  If  a  choice  cannot  be  made,  then  assess 
further  information  about  values  of  impre¬ 
cisely  known  parameters  by  iterating  through 
steps  f»-ll  of  Analysis  IB),  the-  return  to 


(ii)  moving  up  the  attribute  tree  by  deter¬ 
mination  of  a  subset  of  attribute  trade¬ 
off  weights, 

(iii)  "tightening"  bounds  on  attribute  trade¬ 
off  weights, 

(iv)  "tightening"  bounds  on  event  outcome 
probabilities,  possibly  through  infor¬ 
mation  processing  updates, 

(v)  "tightening  bounds"  on  value  or  prefer¬ 
ence  functions. 

5.  If  the  decisionmaker  has  provided  (partial)  whol¬ 
istic  preferences  as  part  of  the  analysis  effort, 
use  these  with  the  inverse  aiding  feature  of  the 
aid  to  determine  bounds  on  attribute  weights 
implied  by  these  preferences  such  as  to  provide 
learning  feedback  to  decisionmaker. 

6.  Conduct  sensitivity  analysis.  Provide  the  deci¬ 
sionmaker  with  an  indication  of  how  sensitive  the 
optimal  action  alternative,  or  prioritization  of 
alternatives,  is  with  respect  to  changes  in  values 
and  information  about  impacts. 

7.  Evaluate  validity  and  veracity  of  the  approach. 
Encourage  judgment  concerning  whether  the  formu¬ 
lation,  analysis,  and  interpretation  are  sound. 
If  not,  encourage  appropriate  modification  to 
structure  and  parameters  associated  with  the 
decision  situation,  including  identification  of 
additional  attributes  and  alternative  courses  of 
action.  Then,  iterate  back  to  an  appropriate  step 
and  continue. 

In  our  work  to  date,  we  assume  that  the  details  of 
issue  formulation  and  analysis  are  accomplished  ex¬ 
ternal  to  the  interactive  aid  itself.  There  are  a 
variety  of  procedures  for  accomplishing  these  tasks. 
[10]  Our  research  assumes  that  there  exists  an  issue 
formulation  structure  and  that  the  impacts  of  alterna¬ 
tives  are  known.  These  are  provided  .through  various 
elicitation  activities.  We  do  not  envision  that  the 
software  we  develop  for  interactive  interpretation, 
including  evaluation  and  prioritization,  will  generally 
be  suitable  for  use  independent  of  a  trained  decision 
analyst.  Whether  software  can  be  evolved  to  result  in 
an  appropriate  "stand  alone"  aid  is  very  dependent 
upon  the  environment  and  other  factors  that  constitute 
the  contingency  task  structure  for  a  specific  situa¬ 
tion.  In  situations  which  are  repetitive  and  environ¬ 
ments  which  are  stable,  such  as  in  health  care  or 
equipment  fault  diagnosis  situations  for  example,  it 
seems  entirely  possible  to  design  useful  "stand  alone" 
aids.  In  most  strategic,  and  in  many  tactical  situa¬ 
tions  there  will  not  be  a  stable  underlying  structure 
that  will  easily  allow  this.  The  activities  involved 
in  issue  framing  and  the  i dent i f i ca t i on  of  a  dominance 
structure  appropriate  for  deci s ionmak ing  are  often  very 
situation  dependent. 

There  are  a  number  of  considerations  that  influ¬ 
ence  planning  and  decision  support  processes.  The 
person  using  a  decision  support  system  should  be  aware 
of  these  considerations  if  best  use  ol  the  aiding 
process  is  to  he  obtained.  Generally  these  considera- 
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tious  involve  the  operational  environment  and  the 
familiarity  of  the  decisionmaker  with  the  environment 
and  task  at  hand.  Tt  is  the  interaction  of  these 
factors  that  influence: 

(1)  behavioral  characteristics  of  the  decision¬ 
maker  , 

(2)  interaction  between  decisionmaker  and  ana¬ 
lyst, 

(3)  choice  of  computer-based  support  for  deci¬ 
sionmaker  analyst  interaction 

Among  the  behavioral  characteristics  of  the  de¬ 
cisionmaker  that  influence  aiding  consideration 
strongly  are  the  facts  that  the  decisionmaker: 

(1)  is  often  impatient  with  time  consuming  and 
stressful  assessment  procedures; 

(2)  wants  to  see  some  preliminary  results  prompt¬ 
ly  if  these  are  needed  or  wanted; 

(3)  may  lack  interest  in  interacting  directly 
with  complex  quantitative  procedures  for 
decision  aiding  that  do  not  seem  tailored  to 
the  specific  contingency  task  structure  of 
the  issue  at  hand;  and,  as  a  consequence, 

(A)  requires  a  decision  aiding  approach  that 
adapts  to  the  decisionmaking  style  appro¬ 
priate  for  the  decisionmaker  in  the  given 
contingency  task  structure. 

There  are  a  number  of  considerations  that  in¬ 
fluence  the  most  desirable  interaction  between  the 
decisionmaker  and  the  analyst.  The  interaction  must  be 
such  that  these  result: 

(a)  a  list  of  objectives  and  an  objectives  hier¬ 
archy; 

(b)  a  list  of  al ternatives ;  and 

(c)  a  list  of  outcomes  for  each  alternative. 

The  extent  of  the  need  for  the  use  of  these  identified 
lists  will  vary  greatly  with  the  "expertise”  of  the 
decisionmaker.  A  major  task  of  the  analyst  in  the 
formulation  and  analysis  portion  of  the  aiding  effort 
is  to  assist  the  decisionmaker  in  obtaining  these 
"lists"  in  a  behaviorally  relevant  and  realistic  man- 


The  analyst  must  also  ensure,  to  the  extent  pos¬ 
sible,  that: 

(1)  the  above  lists  are  reasonably  complete; 

(2)  the  lowest  level  objectives  are  additively 
independent ; 

(3)  the  alternatives  are  mutually  exclusive,  and 

(A)  the  outcomes  that  follow  from  each  alterna¬ 
tive  are  mutually  exclusive  and  exhaustive. 

The  nature  of  the  interactive  process  is  such  that 
iterative  changes  can  he  made  in  terms  of  addition  or 
deletion  of  alternatives  and  attributes.  Nevertheless, 
there  are  significant  advantages  in  attempting  to  he 
reasonablv  complete  at  the  start  of  the  interpretation 
portion  of  the  process. 


The  decisionmaker  must  provide  the  analyst,  fol¬ 
lowing  behaviorally  realistic  elicitation  procedures, 
information  regarding: 

(1)  alternative  scores  on  lowest  level  attri¬ 
butes, 

(2)  tradeoff  weights, 

(3)  probabilities,  and 

(A)  relative  risk  aversion  coefficients 

or  appropriate  ratios  or  bounds  on  these  quantities 
which  represent  the  precision  that  the  decisionmaker 
believes  appropriate  or  is  capable  of  providing  for  the 
given  decision  situation. 

There  are  many  computer  based  support  considera¬ 
tions  which  evolve  from  decisionmaker-analyst  interac¬ 
tion  considerations.  A  goal  of  all  decision  support 
system  design  efforts  is  to  obtain  "friendly  software", 
software  that  is  friendly  both  to  the  decisionmaker  and 
the  analyst.  In  particular,  the  analyst  must  be  able 
to  interpret  the  decisionmaker's  structural  and  param¬ 
eter  information  for  input  to  the  computer.  To  do  this 
may  require: 

(1)  redefining  the  outcome  space,  such  as  redefi¬ 
nition  of  attributes  to  ensure  satisfaction 
of  independence  considerations  and 

(2)  describing  parameter  information  in  terms  of 
inequalities  (or  more  generally  set  member¬ 
ship). 

The  analyst  must  be  able  to  interpret  computer 
output  in  a  fashion  that  facilitates  the  decision- 
maker's  understanding  and  decisionmaking  abilities. 
The  analyst  must  be  able  to  assist  the  decisionmaker  in 
responding  to  the  following  question  which  is  central 
in  our  interactive  knowledge  based  support  system: 

Has  sufficient  preference  and  structural 
information  been  elicited  from  and  provided  to  the 
decisionmaker  for  alternative  selection,  or  is 
more  information  required  for  identification  of  a 
dominance  structure  that  is  relevant  and  appro¬ 
priate  for  quality  decision  support? 

If  the  decisionmaker  feels  that  an  alternative  can 
be  selected  for  action  implementation  at  any  stage  in 
the  interactive  aiding  effort,  the  analyst  must  be  able 
to  encourage  decisionmaker  judgment  concerning  whether 
or  not  the  issue  formulation,  analysis,  and  interpre¬ 
tation  are  sound.  If  the  issue  formulation,  analysis, 
and/or  interpretation  are  not  perceived  as  sound  by  the 
decisionmaker,  the  analyst  must  be  able  to  encourage 
appropriate  structural  and  parameter  value  modifica¬ 
tion,  typically  by  means  of  sensitivity  analysis,  in 
order  to  insure  effective,  explicable,  and  valid  plann¬ 
ing  and  decision  support.  If  the  decisionmaker  cannot 
choose  an  alternative  from  among  those  considered,  the 
analyst  must  be  capable  of  eliciting  further  structural 
and/or  parameter  information  to  enhance  appropriate 
selection  of  alternative  courses  of  action. 

One  very  important  feature  of  a  knowledge  based 
system  for  planning  and  decision  support  is  encourage¬ 
ment  to  the  decisionmaker  for  generating  new  options, 
outcomes,  and  attributes  at  essentially  any  point  in 
the  aiding  effort;  and  ability  to  properly  evaluate 
these  new  options.  The  analyst  must  be  able  lo  cope 
with  this  additional  information  under  the  assumption 
that : 
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(1)  the  new  information  ia  consistent  with  pre¬ 
viously  obtained  information;  or 

(2)  the  new  information  is  not  consistent  with 
previously  obtained  information  due  to 

(a)  structural  inconsistencies,  or 

(b)  parameter  inconsistencies. 

Thus,  the  capacity  to  resolve  potential  inconsis¬ 
tencies  through  interaction  with  the  decisionmaker  must 
exist  within  the  planning  and  decision  support  process. 
The  indirect,  or  inverse  decision  aiding,  feature 
should  be  of  particular  value  to  this  end.  In  a  "poli¬ 
cy  capture"  like  fashion,  this  indirect  feature  will 
allow  identification  of  bounds  on  attribute  weights  in 
terms  of  wholistic  preferences  among  some,  or  all, 
alternatives.  In  the  direct  aiding  feature,  values, 
weights,  and  probabilities  are  identified  and  priori¬ 
tization  of  alternatives  result  from  this.  Combined 
use  of  the  direct  aiding  feature  with  indirect  aiding 
should  result  in  much  learning  feedback  concerning 
relations  among  the  various  modes  of  judgment. 

ARIADNE,  as  we  have  noted,  does  not  contain  soft¬ 
ware  to  assist  in  the  formulation  and  analysis  portion 
of  the  planning  and  decision  support  effort.  It  is  in 
these  two  steps  that  alternative  choices,  attributes 
and  decision  impacts  or  outcomes  are  elicited  or  iden¬ 
tified.  Our  effort  is  much  more  concerned  with  the 
interpretation  part  of  a  decisionmaking  effort;  that  is 
to  say  how  information  is  processed  concerning  formula¬ 
tion  and  analysis  based  quantities  such  as  probabili¬ 
ties,  values,  weights,  ratios,  and  bounds  upon  these. 
We  are  concerned  also  with  the  way  in  which  this 
information  is  aggregated,  by  any  of  a  variety  of 
formal  knowledge,  rule  based,  or  skill  based  modes  of 
cognition  that  result  in  judgment  and  choice.  We 
recognize  the  difficulties  in  separating  the  tasks 
of  formulation  and  analysis  from  those  of  interpre¬ 
tation.  There  are  difficulties  at  the  systems  manage¬ 
ment  level  since  the  way  in  which  people  cognize  a 
problem,  as  part  of  the  contingency  task  structure  of  a 
particular  situation,  determines  the  way  in  which  they 
will  go  about  resolving  it.  Thus  the  performance 
objectives,  information  processing  style,  and  decision 
style  that  are  most  appropriate  and  that  are  likely  to 
be  used  for  a  given  task,  are  very  much  dependent  upon 
the  task  itself.  When  a  particular  concrete  opera¬ 
tional  or  skill  based  strategy  has  yielded  previous 
satisfactory  results,  many  people  will  tend  to  use  that 
strategy  unquestioningly  and  uncritically  in  new  situa¬ 
tions  perceived  to  be  similar.  This  can  result  in  very 
unsatisfactory  judgments  and  choices  in  decision  situa¬ 
tions  that  have  changed  and  that  are  not  recognized  as 
different  from  familiar  past  situations.  This  may 
result  in  premature  cessation  of  search  and  evaluation 
of  alternatives  prior  to  identi f ica tion  of  quality 
strategies,  even  for  familiar  situations.  The  efforts 
can  be  devastating  in  unfamiliar  environments  that  are 
not  so  recognized  fll). 

The  strategies  which  .1  decisionmaker  will  desire 
to  use  for  interactive  interpretation  will  be  strongly 
dependent  upon  the  way  in  which  the  task  requirements 
are  initially  cognized.  This  will  influence  the  objec¬ 
tives,  attributes,  and  alternatives  generated  in  the 
formulation  step  and  the  value  scores  or  impacts  asso¬ 
ciated  with  them  in  the  analysis  step.  The  input 
information  to  the  interpretation  step  is  just  this 
information.  Adequacy  of  the  interactive  interpi sta¬ 
tion  step  will  clearly  he  dependent  upon  the  "quality" 
of  the  information  input  to  it. 

*1any  recent  studies  (  1 2 1  have  indicated  that 
people  often  conitr-  selectively  perceived  simple 


deterministic  representations  of  decision  situations 
that  make  information  processing  easy  and  which  do  not 
reflect  the  complexities  and  uncertainties  that  are 
associated  with  the  actual  situation.  A  goal  of  a 
decision  support  system  is  to  encourage  wide  scope 
perceptions  and  associated  information  processing.  The 
process  used  to  assess  probabilities,  utilities,  and 
weights  will  doubtlessly  affect  the  quantities  that  are 
elicited.  It  is  possible,  for  example,  that  a  poor 
elicitation  procedure  may,  unknowingly  or  knowingly, 
create  rather  than  measure  values  (13).  An  advantage 
to  formal  support  for  planning  and  decisionmaking 
processes  is  that  it  is  possible  to  conduct  a  search 
for  inconsistent  judgment  and  perhaps  even  detect 
flawed  information  processing  heuristics  if  process 
tracing  is  used.  When  inconsistencies  are  discovered, 
it  then  becomes  possible,  at  least  in  principle,  to 
examine  the  judgment  process  to  determine  which  judg¬ 
ments  imply  flawed  information  processing,  and/or 
incoherent  or  labile  values,  and/or  deficient  decision 
rules.  A  major  ultimate  goal,  outside  the  scope  of  our 
present  study,  is  to  suggest  debiasing  and  other  cor¬ 
rective  procedures  to  enhance  the  quality  of  human 
information  processing  and  decision  rule  selection. 

This  mixed  scaoning  based  planning  and  decision 
support  system  is  based  upon  rational  search  for  a 
dominance  structure  which  will  enable  exposure  of  some 
of  the  processes  upon  which  judgment  and  choice  is 
based.  In  particular,  it  enables  determination  of  the 
precise  point  in  a  dominance  structure  search  process 
when  a  decisionmaker  is  able  to  select  a  single  non- 
dominated  alternative.  We  should  be  able  to  do  this 
without  resorting  to  a  complete  elicitation  of  precise 
parameter  information  and  prioritization  of  all  alter¬ 
natives.  The  activity  of  complete  precise  determina¬ 
tion  of  all  parameter  information  is  often  stressful 
and  time  consuming,  may  require  perspectives  outside  of 
the  experiential  familiarity  of  the  decisionmaker,  and 
allows  few  results  until  conclusion  of  the  aiding 
effort . 

The  overall  process  described  here  appears  well 
suited  to  accommodating  the  fact  that  neither  indi¬ 
viduals  nor  groups  possess  static  decision  styles 
capable  of  being  stereotyped  and  captured  by  a  rigid, 
inflexible  support  process.  It  is  specifically  recog¬ 
nized  that  an  interactive  process  is  needed  that  is 
capable  of  adaptation  to  a  variety  of  decision  styles 
that  are  contingency  task  structure  dependent.  System 
design  should  reflect  the  realization  that  is  generally 
not  possible  to  define  a  problem  or  issue  fully  until 
one  knows  potential  solutions  to  the  issue.  A  major 
cause  of  this  is  the  fact  that  information  to  fully 
define  the  issue  generally  becomes  available  only  as 
one  evaluates  potential  solutions.  Planning  and  de¬ 
cisionmaking  will  therefore  necessarily  be  iterative. 

4.  Behavioral  Relevance  Issues 

Our  decision  support  system  design  paradigm  is 
based  upon  a  process  model  of  decisionmaking  in  which  a 
person  perceives  an  issue  which  may  require  a  change  in 
the  existing  course  of  action.  On  the  basis  of  a 
framing  of  the  decision  situation,  one  or  more  al¬ 
ternative  courses  of  action,  in  addition  to  the  present 
option  which  may  he  continued,  are  identified.  A 
preliminary  screening  of  the  alternatives,  using  con¬ 
junctive  and  disjunctive  scanning,  may  eliminate  all 
but  one  alternative  course  of  action.  Unconf 1 icted 
adherence  to  the  present  course  of  action  or  uncon¬ 
flicted  change  to  a  new  option  may  well  be  the  meta 
strategy  for  judgment  and  choice  that  is  adopted  if  the 
decisionmaker  perceives  that  the  decision  situation  is 
a  familiar  one  and  that  the  stakes  are  not  so  high  that 
a  more  thorough  search  and  deliberation  is  needed  (11). 


Alternately,  if  the  decision  environment  is  an 
unfamiliar  one,  or  the  stakes  associated  with  judgment 
and  choice  are  high,  a  more  vigilant  form  of  informa¬ 
tive  acquisition,  analysis,  and  interpretation  are 
called  for.  This  desire  for  more  vigilant  information 
processing  leads  to  a  search  for  a  dominance  pattern 
among  alternatives,  the  search  for  new  alternatives 
that  are  not  dominated  by  presently  identified  alter¬ 
natives,  and  the  elimination  from  further  consideration 
of  alternatives  that  are  dominated.  If  no  single  non- 
dominated  alternative  is  found,  adjustments  to  the 
dominance  structure  of  alternatives  are  made  through 
various  forms  of  cognitive  activity  such  as:  attribute 
aggregation,  additional  information  acquisition  and 
analysis,  and  identification  of  additional  attributes 
and/or  alternatives.  This  is  continued  until  the 
structure  of  needs,  objectives,  attributes,  and  alter¬ 
native  action  options,  and  their  impacts  are  such  that 
identification  of  a  single  non-dominated  alternative 
results.  This  "single  alternative"  may  well  represent 
a  combination  of  subalternatives .  If  there  is  insuf¬ 
ficient  time  and  experience  to  accomplish  these  cog¬ 
nitive  activities,  hypervigilance  generally  results. 
The  decisionmaker  is  in  a  situation  where  the  present 
course  of  action  is  diagnosed  as  unfortunate  and  there 
is  a  shortage  of  time  and  experience  that  might  enable 
identification  and  evaluation  of  an  appropriate  one. 

Given  sufficient  time  and  experience,  vigilant 
information  processing  often  results  from  the  afore¬ 
mentioned  tasks.  Figure  1  presents  some  salient  fea¬ 
tures  of  this  dominance  process  model  for  search, 
discovery,  judgment,  and  choice. 

The  mode  of  judgment  and  choice  that  is  "proper" 
depends  upon  the  decisionmaker's  situation  diagnosis  of 
the  contingency  task  structure.  Here,  "proper"  deci¬ 
sion  behavior  is  based  upon  the  assumption  that  the 
environment,  the  task,  the  experiential  familiarity 
with  the  task,  and  the  environment  that  constitutes  the 
contingency  task  structure  are  diagnosed  correctly.  If 
this  is  not  the  case,  then  the  strategies  leading  to 
unconflicted  change,  adherence,  or  vigilant  information 
processing  may  be  significantly  flawed.  The  role  of 
the  contingency  task  structure  in  situation  diagnosis 
and  in  influencing,  at  a  meta  level  or  systems  manage¬ 
ment  level,  the  process  of  judgment  and  choice  is, 
therefore,  a  very  important  one. 

There  have  been  many  realistic  paradigms  of  the 
process  of  judgment  and  choice.  We  believe  that  the 
dominance  process  model  described  here  is  not  incon¬ 
sistent  with  the  primary  features  and  intensions  of 
these  descriptive  models.  Our  purpose,  however,  is  to 
develop  a  conceptual  design  for  a  prescriptive  approach 
to  Judgment  and  choice  that  will  aid  in  the  search  for 
better  decisions.  We  recognize  that  a  truly  rational 
approach  to  prescriptive  decisionmaking  must  be  cog¬ 
nizant  of  the  process  of  decisionmaking  as  it  evolves 
in  a  descriptive  fashion,  that  is  to  say  process  ra¬ 
tionality,  or  it  will  not  be  possible  to  evolve  sub¬ 
stantively  rational  support  systems. 

ft  is  important  that  an  appropriate  decision 
support  system  be  capable  of  assisting  the  decision¬ 
maker  through  encouragement  of  full  information  acqui¬ 
sition,  including  that  which  may  disconfirm  strongly 
held  beliefs,  and  in  the  analysis  and  interpretation  of 
this  information  such  as  to  avoid  a  variety  of  cogni¬ 
tive  biases  and  poor  information  proces  ing  heurtr.Lics 
that  may  lead  to  flawed  judgment  and  choice 

A  realistic  decision  support  process  is  neces¬ 
sarily  iterative.  Several  desiderata  follow  from  this: 


1.  We  should  allow  for  top-down  or  bottom-up 
structuring  of  the  attributes  of  outcomes,  or 
impacts  of  decisions.  The  "tree"  or  "hier¬ 
archy"  of  attributes  should  be  structured  to 
the  depth  believed  appropriate  by  the  de¬ 
cisionmaker. 

2.  Rather  than  force  a  decision  situation  struc¬ 
tural  model  in  the  form  of  a  tree,  we  should 
encourage  the  decisionmaker  to  identify  a 
cognitive  map  of  goals,  objectives,  needs, 
attributes,  alternatives,  and  impacts  tha'„  is 
reflective  of  the  way  in  which  the  decision¬ 
maker  perceives  diagnostic  and  causal  infer¬ 
ences  to  occur.  At  some  later  time  this 
cognitive  map  may  be  used  to  structure  a 
mult inode  decision  tree  which  is  represen¬ 
tative  of  substantive  rationality,  but  not  at 
all  necessarily  representative  of  process 
rationality. 

3.  We  should  encourage  identification  of  alter¬ 
native  courses  of  action,  additional  attri¬ 
butes  of  decision  outcomes,  and  revisions  to 
previously  obtained  elicitations ,  at  any 
point  in  the  decision  support  process  as 
awareness  of  the  decision  situation  and  its 
structure  grows  through  use  of  the  support 
system. 

4.  We  should  not  force  a  person  to  quantify 
parameters  to  the  extent  that  this  becomes 
overly  stressful,  or  behavioraily  and  phy¬ 
sically  irrelevant  in  view  of  the  inherent 
uncertainties  or  imprecision  that  is  asso¬ 
ciated  with  the  knowledge  of  parameters 
characterizing  the  decision  situation  struc¬ 
tural  model  or  their  assessment. 

These  have  two  primary  implications  with  respect 
to  our  interpretation  efforts.  We  allow  for  revision 
in  the  elicited  structure  of  the  decision  situation  and 
for  the  identif ication  of  new  options  as  awareness  of 
the  decision  situation  grows.  Also,  we  do  not  require 
the  decisionmaker  to  quantify  parameters  beyond  the 
level  felt  appropriate  for  the  situation  at  hand.  If 
the  decisionmaker  feels  comfortable  in  exercising 
precision  with  respect  to  factual  outcomes,  this  is 
perfectly  acceptable  and  desirable.  But  parameter 
imprecision  should  be  allowed  if  we  are  to  have  a 
realistic  support  process. 

ARIADNE  allows  parameter  imprecision  in  order  to 
satisfy  this  quantification  relevancy  requirement,  as 
do  approaches  based  on  fuzzy  set  theory  (16).  We 
encourage  the  decisionmaker  to  specify  precise  values 
or  numerical  ranges  for  facts  and  values.  Thus  we 
allow,  for  example,  expressions  for  alternative  (A) 
scores  on  attributes  (i)  in  the  form  0,2  <  v^(A)  <  0.5, 

weights  associated  with  attribute  i  in  the  form  0.2  < 
w.  <  0.4,  and  probabilit ies  of  event  (i)  resulting  from 

alternative  A  in  the  form  0.3  <  P^(A)  <  0.45.  We  allow 

ordinal  representations  in  the  linear  forms  v^(A)  < 

v  (B)  <  v  (C),  2w.  <  w.  <  w  ,  P . ( A)  <  P . ( A)  <  3P  (A), 
i  i  i  J  *  J  ^  x 

or  in  similar  forms.  Quantification  of  imprecision 
in  the  form  of  numerical  hounds  on  parameters  always 
leads  to  what  we  call  "hehaviora 1 ly  consistent  infor¬ 
mation  sets  (BCIS)."  Sometimes  totally  ordinal  infor¬ 
mation  may  need  further  quantification  in  order  to  make 
the  precision  and  rigidity  of  the  mathematics  cor¬ 
respond  to  the  intensions  of  the  decisionmaker  in 
making  a  purely  ordinal  specification.  This  is  gen¬ 
erally  not  needed  to  obtain  solutions  but,  rather,  to 


obtain  parametric  models  that  are  faithful  to  the 
understandings  of  the  decisionmaker.  For  example  that 
ordinal  alternative  score  inequalities  0  <  v^(A)  < 

v^(B)  <  v^(C)  <  1  are  satisfied  by  the  relations  0  < 
v.(A)  <  l-2t,  W  <  vi(B)  <  1-t,  2W  <  vi(C)  <  1  for  small 

positive  t  and  W  which  in  the  limit  become  zero.  It 
will  generally  not  be  the  case  that  the  decisionmaker 
would  express  this  much  imprecision,  and  would  wish  to 
see  it  more  fully  quantified  to  be  reflective  of  (sub¬ 
jective)  beliefs.  It  is,  therefore,  important  that  a 
simple  aod  informative  display  of  value  scores, 
weights,  and  probabilities  be  provided  to  the  decision¬ 
maker.  This  will  enhance  interactive  use  of  the  sup¬ 
port  system  and  will  enable  learning  of  the  impact  of 
these  parameters,  and  associated  imprecision,  upon 
decisions . 

5 .  Conclusions 

In  this  paper,  we  have  examined  some  underlying 
considerations  that  have  influenced  the  development  of 
a  decision  support  system  that  specifically  recognizes 
that  imprecise  and  incomplete  knowledge  is  important  to 
judgment  and  choice  and  which  allows  for  its  incor¬ 
poration  in  the  knowledge  base  of  a  decision  support 
system.  The  system  allows  for  judgment  and  choice  at  a 
skill  based  wholistic  level  as  well  as  at  the  formal 
reasoning  based  level  at  which  most  decision  analysis 
based  paridms  operate.  For  detailed  discussions  of  the 
algorithmic  content  of  ARIADNE,  the  reader  is  referred 
to  [6,7,14-26}. 
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In  this  paper,  we  present  the  objectives, 
operational  details,  results,  and  conclusions  of  an 
evaluation  of  a  decision  aiding  procedure  ARIADNE.  The 
results  of  the  evaluation  indicate  that  ARIADNE,  in 
comparison  to  a  well-known  decision  aiding  procedure 
called  SMART,  (l)  has  a  more  flexible  model  of 
parameter  value  description  that  tends  to  reduce 
assessment  stress  and  makes  ARIADNE  more  useful  in 
situations  where  information  precision  is  poor,  <2) 
allows  earlier  presentation  of  initial  alternative 
ranking  information  and  (3)  allows  the  decisionmaker  to 
adjust  the  mix  of  alternative  ranking  specificity  and 
parameter  value  precision. 

! .  INTRODUCTION 

In  this  paper,  we  present  the  objectives, 
operational  details,  results,  and  conclusions  of  an 
evaluation  of  two  decision  aiding  approaches,  ARIADNE 
and  SMART.  An  indepth  description  of  SMART  (Simple, 
Mult i At  t r ibut  e  Rating  Technique)  can  be  found  in 
Edwards  (1977);  Oetalled  discussions  and  algorithmic 
descriptions  of  ARIADNE  (Alternative  Ranking 
Interactive  Aid  based  on  Dominance  structure 
information  Elicitation)  are  presented  in  the  companion 
paper  (Sage  and  White,  1983).  In  Section  II,  we  ll9t 
the  hypotheses  that  were  tested  during  the  evaluation. 
The  operational  aspects  of  the  evaluation  are  detailed 
in  Section  III.  We  present  the  results  of  the 
evaluation,  and  the  conclusions  that  we  obtain  from 
these  relative  to  the  identified  hypotheses,  in  Section 
IV. 

II.  IDENTIFIED  HYPOTHESES: 

The  intent  of  the  evaluation  was  to  test  the 
following  hypotheses:  ( 

1 .  Use  of  the  more  general  model  of  parameter  value 
description  in  ARIADNE  tends  to  reduce  stress 
associated  with  the  assessment  of  alternative 
values  and  attribute  weights. 

2.  Use  of  the  more  general  model  of  parameter  value 
description  in  ARIADNE  tends  to  Increase 
confidence  in  the  final  alternative  selected. 

3.  The  ability  to  provide  additional  parameter 
information,  in  a  form  and  sequence  selected  by 
the  decisionmaker,  and  to  observe  its  impact  on 
alternative  ranking  in  an  iterative  fashion  is  a 
desirable  feature  of  ARIADNE. 
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4.  ARIADNE  requires  less  time  for  use  than  does 
SMART. 

5.  Decisionmakers  do  not  feel  that  it  is  necessary 
for  an  aid  to  produce  a  single  best  alternative  to 
assist  the  decisionmaker  in  selecting  the  most 
preferred  alternative. 

6.  ARIADNE  is  more  useful  than  SMART  in  situations 
where  information  precision  is  poor. 

7.  Problems  typically  encountered  in  the  subjects' 
operational  environment  would  be  more 
appropriately  examined  aided  bv  ARIADNE  than  aided 
by  SMART. 

8.  ARIADNE  is  no  more  difficult  to  understand  and  use 
than  SMART. 

We  now  discuss  the  procedures  for  testing  these 
hypotheses  • 

rrr.  operational  aspects  of  evaluation 

Eight  (8)  civilians  employed  by  the  United  States 
Army  Foreign  Science  and  Technology  Center  (FSTC) 
participated  as  subjects  in  the  evaluation.  Each  of 
the  subjects  had  had  extensive  involvement  in  technical 
project  evaluation  in  a  military  environment  and  thus 
had  sufficient  experience  to  appreciate  the 
difficulties  and  operational  issues  involving  proposal 
evaluation.  Proposal  evaluation  was  a  subject 
addressed  in  the  more  specialized  of  the  two 
decisionmaking  scenarios  examined  by  the  subjects 
during  the  evaluation. 

The  two  scenarios  developed  for  the  evaluation 
were  proposal  evaluation  and  sports  car  selection.  Each 
of  these  scenarios  can  be  obtained  from  the  authors. 
It  was  assumed  that  each  scenario  involved 
decisionmaking  under  certainty.  The  first  scenario  was 
designed  to  represent  a  realistic  proposal  evaluation 
problem  that  might  occur  in  a  DOD  funding  agency. 
Although  attributes  and  some  ordinal  relations  among 
attribute  weights  were  specified  in  the  RFP  to  which 
the  proposals  were  to  respond,  information  presented  in 
the  five  (3)  submitted  proposals  from  which  to  deduce 
utility  scores  and  hence  tradeoff  weights  was  often 
vague  and/or  not  available.  Also,  there  was  room  for 
judgement  in  strengthening  the  ordinal  relations  among 
the  attribute  weights  that  were  provided  in  the  RFP 
summarized  in  the  scenario.  The  sports  car  selection 
scenario  was  designed  to  represent  a  much  more 
precisely  defined  alternative  selection  problem. 

Standard  procedure*  were  used  in  order  to 
Investigate  and  compensate  for  effects  due  to 
facilitation  style  And  order  with  respect  to  decision 
aid  and  scenario. 
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The  chronology  for  the  evaluation  was  as  follows: 

1.  General  briefing.  A  briefing  was  given  to  the 
volunteer  subjects  regarding  the  purpose  of  the 
evaluation  and  the  characteristics  of  the  two  aids. 
Individual  evaluation  sessions  were  scheduled,  and  both 
scenarios  were  given  to  the  subjects  to  read  prior  to 
the  individual  sessions. 

2.  Individual  sessions.  Individual  evaluation 

sessions  were  conducted.  Each  session  for  each 

individual  subject  involved  a  subject,  facilitator,  and 
computer  terminal  operator.  If  ARIADNE  was  used, 
assessed  information  regarding  lowest  level  attribute 
utility  scores  and  tradeoff  weights  was  allowed  to  be 
imprecise  and  was  translated  into  linear  inequalities 
by  the  facilitator  and/or  computer  terminal  operator. 
Initially,  only  utility  score  information  for  the 
alternatives  on  the  identified  attributes  was  assessed. 
Once  this  assessment  was  completed,  a  domination 
digraph  on  the  alternatives  was  computed  and  displayed 
to  the  subject.  The  subject  could  also  view  a  score 
sheet  of  values  from  which  this  digraph  was  obtained. 
If  this  digraph  provided  sufficient  information  tor 
alternative  selection,  then  this  portion  of  the  session 
was  halted.  If  not,  then  further  utility  score  and/or 
tradeoff  weight  information  was  requested  and  the 
resulting  domination  digraph  displayed.  This 
ir format  ion  could  concern  attribute  scores  and  weights 
not  previously  obtained  or  more  precise  estimates  of 
previously  elicited  scores  and  weights.  This  iterative 
procedure  continued  until  the  subject  halted  the 
process. 

If  SMART  was  used,  all  parameters  were  precisely 
assessed.  Then  the  total  linear  order  on  the 
alternatives  was  displayed.  If  the  subject  wished,  a 
post  optimal  sensitivity  analysis  was  performed  on 
whatever  single  parameter  values  were  of  concern. 
Detailed  descriptions  of  facilitation  protocols  can  be 
obtained  from  the  authors. 

During  the  examinations  of  each  scenario,  the 
computer  terminal  operator  completed  an  Analyst 
Information  Sheet,  detailing  various  times  and  types  of 
requests.  After  completing  both  scenarios,  the 
subjects  were  asked  to  complete  a  short  questionnaire 
and  return  it.  Copies  of  both  the  Analyst  Information 
Sheet  and  the  Questionnaire  can  be  obtained  from  the 
authors • 

IV.  RESULTS  AND  CONCLUSIONS: 

We  now  examine  each  of  the  hypotheses  in  the 
context  of  data  collected  during  the  evaluation. 

> 

Hypothes  li  >  I:  Use  of  the  more  general  model  of 
parameter  value  description  in  ARIADNE  tends  to  reduce 
stress  associated  with  the  assessment  of  alternative 
values  and  attribute  weights.  Relevant  Questionnaire 
questions  (0)  and  responses  <R): 

01:  Being  allowed  to  express  parameter  values 

imprecisely  using  ARIADNE  produced  more  stress 
than  being  required  to  state  all  parameter  values 
precisely  using  SMART. 

R:  (presenting  individual  subject  scores  below  the 

line;  +5(-3)  indicates  strong  (dls) agreement) 

->  2 _ ZZ 

l  f>  a  7  i  -  > 

indicating  a  tendency  to  agree  with  the  hvpothesis. 
There  were  tw*»  relevant  comments:  SI  (Subject  1). 
"Liked  the  flexibility." 


S3:  "Perhaps  more  stress  initially  (with  ARIADNE) 
because  I  didn't  understand  the  process.  But 
after  using  it,  I  would  be  inclined  to  say  far 
less  stress  (with  ARIADNE)  for  complex 
applications." 

Q6:  What  was  the  most  comfortable  way  of  expressing 
parameter  value  information  for  you? 

R:  Indicated  that  two  subjects  (S2»  S3)  preferred 

exact  values,  two  subjects  (SI,  S8)  preferred 
Interval  estimates,  and  four  (S3,  S4,  S6,  S7) 

preferred  ranking  statements  for  expressing 
parameter  value  Information.  There  was  one 
relevant  comment  from  S3:  "for  the  exercise 
today,  (exact  value]  would  be  the  answer;  however, 
for  actual  application  in  complex  areas,  (ranking 
statements)  is  my  answer."  These  responses 

cause  us  to  conjecture  that  if  the  subjects  had 
been  more  experienced  in  expressing  parameter 
values  imprecisely  (several  had  experience  in 
expressing  value  scores  and  tradeoff  weights 
precisely)  then  there  would  have  been  stronger 
support  for  this  hypothesis. 

Hvpothesis  2:  Use  of  the  more  general  model  of 
parameter  value  description  in  ARIADNE  tends  to 
increase  confidence  in  the  final  alternative  selected. 
Relevant  Questionnaire  questions  and  responses: 

Q2 :  I  felt  more  confidence  in  the  final  alternatives 
chosen  when  aided  by  ARIADNE  than  in  the  final 
alternative  produced  when  aided  by  SMART. 

R: 

-5 _ _ 0 _ +3 

2  7  4  13 

5  8 

6 

indicating  slight  support  for  the  hypothesis.  There 
were  no  especially  relevant  written  comments. 

Q8 :  I  disagreed  with  the  action  alternative 

recommendation  obtained  using  ARIADNE. 

R:  (S  1  ,...,S7)  "no";  S8  "don't  remember." 

Q14:  I  disagreed  with  the  action  alternative 

recommendation  obtained  using  SMART. 

R:  S  2  "yes;"  (SI,  S3 .  S7)  "no;"  S8  "don't 

remember."  Thus,  responses  to  questions  the 
latter  2  indicate  no  recognizable  difference  in 
the  perceived  quality  of  the  decisions  made  using 
ARIADNE  versus  those  made  using  SMART.  There  were 
no  relevant  comments  associated  with  either 
question. 

017:  Which  approach  would  you  prefer  to  use  to  make 
recommendations  to  others  concerning  evaluation 
and  prioritization  and  why? 

R:  (SI,  S3,  S  7 ,  S  8 )  "ARIADNE;"  (S2,  S3,  S6)  "SMART;" 

S4  "neither."  Three  relevant  comments  were  made: 
S4:  "Depends  on  Situation."  S6:  "Since  SMART 

gives  percentages,  one  can  see  If  two  proposals 
are  close  and  then  adjust  the  rankings  bv 
consideration  of  factors  that  were  not  originally 
considered.”  S7:  "Bv  onlv  indicating  preference 
as  opposed  to  exact  values  is  very  helpiul;  weight 
max-min  display  nt*~e  feature." 

We  feel  Se's  comments  Lends  to  explain  his  response  to 
this  question.  The  comments  ot  S6  and  S7  indicate  that 
the  max-mtn  display  (indicating  the  maximum  and  minimum 
values  of  expected  utility  for  each  alternative) 
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Incorporated  into  ARIADNE  waa  liked  by  S7  and  may  not 
have  been  requested  by  S6.  We  conjecture  that  had  S6 
seen  this  display,  his  response  would  have  been 
different. 

012:  Use  of  ARIADNE  encouraged  me  to  carefully  weigh 
the  positive  and  negative  consequences  of  each 
alternative. 

Q16:  Use  of  SMART  encouraged  me  to  carefully  weigh  the 
positive  and  negative  consequences  of  each 
alternative. 

Responses  to  012  and  Q16  were,  respectively: 

-5 _ 0 _ 5 

6  5  2  3  4  1 

7  8 


-5 _ 0 _ 5 

3  17  2  5 

4 
6 
8 

indicating  that  ARIADNE  and  SMART  provided  an 
approximately  equal  level  of  encouragement  to  the 
subject  for  him  to  carefully  weigh  the  positive  and 
negative  consequences  of  each  alternative. 

In  summary,  questionnaire  responses  indicate  that 
the  level  of  confidence  in  the  output  of  ARIADNE  and 
SMART  appear  to  be  quite  similar.  Also  indicated  was 
that  both  aids  equally  encourage  the  careful  weighing 
of  the  possible  consequences  of  the  alternatives. 

Hypothesis  V  3.  The  ability  to  provide  additional 
parameter  information,  in  a  form  and  sequence  selected 
by  the  decisionmaker,  and  to  observe  its  Impact  on 
alternative  ranking  in  an  Iterative  fashion  is  a 
desirable  feature  of  ARIADNE.  Relevant  Questionnaire 
questions  and  responses: 

Q3:  Being  able  to  provide  additional  parameter 

information  and  then  to  observe  its  Impact  on 
alternative  ranking  in  an  iterative  fashion,  was  a 
desirable  feature  of  ARIADNE. 

R: 

-5 _ 0 _ 5 

5  6  2  1  8 
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Indicating  strong  support  for  the  hypothesis. 

As  an  indication  of  how  often  the  feature  of 
ARIADNE  being  evaluated  in  this  hypothesis  test  was 
exercised,  the  computer  terminal  operator  recorded  on 
the  analyst  information  sheet  the  number  of  iterations 
required  In  constructing  the  final  domination  digraph. 
The  number  of  iterations  for  each  subject  was 
respectively:  3,  3,  0,  0,  2,  5,  and  3. 

Thus  the  subjects  developed  a  reasonable  level  of 
experience  with  this  feature  of  ARIADNE,  placing  a  high 
level  of  confidence  in  the  responses  to  03. 

Q4 :  Knowing  that  a  single  iteration  always  produces  a 

best  alternative  is  a  desirable  feature  of  SMART. 

R: 

-  •»  <1  ' 


3  A 


indicating  that  the  subjects  found  moderately 
attractive  the  fact  that  SMART  always  produces  a  best 
alternative  in  one  iteration. 

The  responses  to  Q3  and  Q4  indicate  that  the 
decisionmaker  should  be  encouraged  to  be  as  precise  as  i 
possible  in  order  to  reduce  the  number  of  iterations  of 
ARIADNE  for  final  decision  selection. 

Hypothesis  4:  ARIADNE  requires  less  time  for 
use  than  does  SMART.  Relevant  questions  and  responses: 

Q5:  Use  of  SMART  lead  me  to  a  decision  more  quickly 

than  use  of  ARIADNE. 

R: 

-5 _ 0 _ 5 
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indicating  that  the  perceptions  of  the  subjects  tend 
not  to  support  the  hypothesis. 

Timing  data  recorded  on  the  analyst  Information 
sheets  support  the  perceptions  of  the  subjects  with 
regard  to  the  average  total  length  of  time  per  session. 
Let  VET  ■  value  elicitation  time,  WET  -  weight 
elicitation  time,  TST  "  total  session  time.  Then,  the 
timing  data  (in  minutes)  are  as  follows: 


1 

2 

3 

4 

APS 

VET 

41.75 

18.75 

19.25 

21.25 

WET 

9.5 

10.5 

6.0 

14.0 

TST 

57.0 

41.25 

47.25 

51.0 

ccw 

VET 

29.5 

24.25 

28.75 

25.0 

WET 

11.75 

9.75 

10. 0 

11.5 

TST 

57.5 

40.75 

47.0 

51.25 

TOTAL 

VET 

35.625 

21.5 

24.0 

23.125 

WET 

10.625 

10.125 

8.00 

12.75 

TST 

57.25 

41.0 

47.125 

51.125 

where  l  •  ARIADNE,  2  •  SMART,  4  *  proposal  evaluation, 
3  •  sports  car  selection.  Thus,  use  of  ARIADNE 
required  on  average  40%  more  total  time  than  did  SMART 
and  the  proposal  evaluation  scenario  required  on 
average  8.5%  more  time  to  evaluate  than  did  the  sports 
car  selection  scenario.  Both  facilitators  on  average 
required  49.125  minutes  per  scenario. 

Also  recorded  on  the  analyst  information  sheet  was 
the  length  of  time  between  the  beginning  of  the  session 
and  the  beginning  of  the  weight  elicitation  process. 
For  ARIADNE,  this  length  of  time  represents  an  upper 
bound  on  the  length  of  time  to  the  presentation  of  the 
first  digraph.  These  times  for  the  8  subjects  were: 
25,  hI,  20,  30 ,  3 n,  13,  2  5,  35  for  an  average  of  27.625 
seconds.  We  remark  that  SMART  required  approximately 
■•H*.  more  time  to  provide  initial  alternative  ranking 
information  to  the  decisionmaker  than  hid  ARIADNE.  It 
we  assume  that  total  session  times  tor  SMART  and  the 
lengths  of  time  between  the  beginning  oi  the  session 
and  the  beginning  of  the  weight  elicitation  process  tor 
ARIADNF.  are  realizations  ot  normally  distributed  random 
variables  with  unknown  means  and  unknown  variances, 
*:hen  a  standard  statistical  test  indicates  that  these 
realizations  rome  t rom  two  different  random  variables 
with  a  confidence  level  of  greater  than  Q.**5. 
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In  summary,  ARIADNE  required  less  time  to  provide 
initial  alternative  selection  feedback  than  did  SMART 
but  wore  time  to  complete  the  entire  session. 
Therefore,  If  the  alternative  selection  situation  is 
such  that  some  alternative  ranking  information  is  1 
better  than  none,  ARIADNE  would  tend  to  be  the 
preferred  aiding  procedure. 

Hypothesis  if  5.  Decisionmakers  do  not  feel  that  it 
is  necessary  for  an  aid  to  produce  a  single  best 
alternative  to  assist  the  decisionmaker  in  selecting 
the  most  preferred  alternative.  Relevant  Questionnaire 
question  and  response: 

Q7:  It  would  be  necessary  for  an  aid  to  produce  a 

single  most  preferred  alternative  before  I  would 
feel  that  I  could  select  the  best  alternative. 

R: 

-5 _ 0 _ 5 

1  4  2  8  3  7 

5 

6 

indicating  strong  support  for  the  hypothesis.  A  recent 
evaluation  of  a  decision  support  system,  designed  to 
provide  a  nondominated  set  of  alternatives  to  the 
decisionmaker  rather  than  a  single  most  preferred 
alternative,  also  has  supported  this  hypothesis  (White 
et  al.,  1982).  Therefore,  we  conclude  with  high 
confidence  that  decision  situations  do  exist  where  the 
decisionmaker  does  not  find  it  necessary  for  a  decision 
aiding  procedure  to  identify  a  single  most  preferred 
alternative. 

Hypothesis  6.  ARIADNE  is  more  useful  than  SMART 
in  situations  where  information  precision  is  poor. 
Relevant  Questionnaire  questions  and  response: 


09:  ARIADNE  is  more  useful  than  SMART  in  situations 

when  information  precision  is  poor. 

R: 

-5 _ 0 _ 5 

2  6  1 

5  7  3 

4 
8 

indicating  strong  support  for  the  hypothesis.  There 
was  one  relevant  comment:  S8:  "Very  much  agree  that 
ARIADNE  aids  one  with  imprecise  data." 

Hypothesis  0  7.  Problems  typically  encountered  in 
the  subject's  operational  environment  would  be  more 
appropriately  examined  aided  by  ARIADNE  than  aided  bv 
SMART.  Relevant  Questionnaire  questions  and  responses: 

010:  Typical  problem*  encountered  In  mv  operational 
environment  would  not  be  appropriately  examined  by 
SMART. 

Q 1 3 :  Tvpical  problems  encountered  In  my  operational 
environment  would  not  be  appropriately  examined  bv 
ARIADNE. 

Responses  to  010  and  013  were,  respectively: 

-  S _ _ n _ 3 

3  2  6  •*  3  l 
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These  responses  Indicate  a  perceptable  preference  for 
ARIADNE  over  SMART  In  the  subjects'  operational 
environment • 

There  were  no  relevant  comments  to  Q10.  Relevant 
comments  to  Q13  were:  S2:  "My  operational  environment 
does  not  involve  actual  decisionmaking  with  multiple 
criteria.  It  does  involve  analysis  of  the 
decisionmaking  of  other  par ties /governments."  S8: 
"Much  of  the  data  I  deal  with  are  abs  t  rac  t  ."The 
response  of  (and  further  discussions  with)  S2  Indicate 
a  need  for  an  inverse  decision  aiding  procedure  that  is 
not  currently  operational  with  ARIADNE.  The  response 
of  S8  to  Q 1 0  and  013  indicate  that  "abstract"  appears 
to  be  synonymous  with  "vague"  and  "imprecise." 

We  conclude  that  ARIADNE  appears  to  be  somewhat 
better  suited  than  SMART  for  the  operational 
environments  of  the  subjects.  We  suspect  that  this  is 
in  large  part  due  to  the  fact  that  hypothesis  #  6  had 
strong  support. 

Hypothesis  0  8:  ARIADNE  is  no  more  difficult  to 
understand  and  use  than  SMART.  Relevant  Questionnaire 
questions  and  responses: 

Qll:  SMART  is  easier  to  use  than  is  ARIADNE. 

Q 1 5 :  ARIADNE  is  easier  to  understand  than  is  SMART. 

Responses  to  Qll  and  Q15  were,  respectively: 

-5 _ 0 _ 5 

1  6  5  7  2  4  3 

8 

-5 _ 0 _ 5 

3  2  1  7 

4  8  3 

These  responses  indicate  that  SMART  is  both  simpler  to 

use  and  easier  to  understand  than  ARIADNE  and  therefore 
contradict  the  validity  of  the  hypothesis. 

Relevant  comments  to  Qll  were:  S6:  "Since  one  has 
to  be  specific  in  SMART,  it  Is  harder  to  feel 
comfortable  with  the  exactness  of  the  results."  SB: 
"ARIADNE  does  require  some  knowledge  of  computers  and 
the  manipulation  of  data  on  them;  or  at  least  one  that 
can  operate  a  computer.'*  The  S6  response  appears  to 
support  hypothesis  ff  2. 

The  relevant  comment  to  Ql5  was:  S6:  "Since  an 
"interpreter"  was  used,  most  interfacing  problems  were 
el iminated. " 

The  above  data  indicate  that  the  evaluation  results 
contradict  the  veracity  of  this  hypothesis.  However, 
there  are  two  factors  which  contribute  to  this 
contradiction  that  could  possibly  be  eliminated  or 
mollified.  First,  many  ot  the  subjects  had  had 
previous  experience  with  SMART-like  scoring  and 
weighting  assessment  procedures,  and  none  had  had  any 
experience  with  ARIADNE.  Second,  current  facilitation 
procedure*  tor  ARIADNF.  are  more  complicated  and  less 
established  than  those  for  SMART.  We  conjecture  that: 
J.  a  sufficient  amount  of  familiarity  with  the  more 
general  model  ot  parameter  value  incorporated  into 
XRlAPNF.  and  2.  the  completion  ot  truly  established 
facilitation  procedures  for  ARIADNE  (as  exist  tor 
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SMART)would  cause  ARIADNE  to  be  perceived  by  the  user 
as  no  more  difficult  to  understand  and  use  than  SMART. 
Training  time  to  achieve  such  a  level  of  familiarity  is  . 
likely  to  be  longer  for  ARIADNE  than  for  SMART  due  to  j 
the  relative  Increased  flexibility  inherent  in  ARIADNE.  ! 

!  5- 

Other  issues  and  associated  questions : 

Q18 :  Was  the  posterior  sensitivity  analysis  associated  ^ 
with  SMART  helpful? 

019:  Which  decision  making  scenario  was  the  most 
appropriate  for  ARIADNE  and  why? 

Q?‘  Which  decision  making  scenario  was  the  most 
appropriate  for  SMART  and  why? 

Responses  to  Q18,  Q19,  and  Q20  indicated,  respectively, 
that:  1.  the  post-optimality  sensitivity  analysis 

feature  was  useful  in  SMART,  2.  the  proposal  evaluation 
scenario  was  most  appropriately  evaluated  using 
ARIADNE,  and  3.  the  sports  car  selection  scenario  was 
most  appropriately  evaluated  using  SMART.  Generally, 
comments  to  questions  9  19  and  9  20  indicated  that  for 
complex  decision  selection  situations  having  less 
quantitative  information  available,  ARIADNE  would  be 
preferred  to  SMART,  which  provides  further  support  for 
hypothesis  9  6. 

Summary ,  our  evaluation  lends  credence  to  the 
following  claims: 

1.  The  more  flexible  model  of  parameter  value 
description  employed  by  ARIADNE  tends  to  reduce 
assessment  stress  and  makes  ARIADNE  more  useful 
than  SMART  in  situations  where  information 
precision  is  poor. 

2.  The  iterative,  progressive  information 
requirements  associated  with  ARIADNE  is  a 
desirable  feature  that  allows  earlier  presentation 
of  initial  alternative  ranking  information  than 
does  SMART. 

3.  SMART  requires  less  total  time  for  use  than  does 
ARIADNE. 

4.  Being  able  to  adjust  the  mix  of  alternative 
ranking  specificity  and  parameter  value  precision 
is  a  desirable  feature  of  ARIADNE. 

3.  ARIADNE  may  require  more  training  than  would  be 
required  by  SMART  for  successful  use. 
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The  level  of  confidence  in  the  output  of  ARIADNE 
and  SMART  appear  to  be  quite  similar. 
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ABSTRACT 

In  this  paper,  we  examine  the  issue  of  inconsistency  and 
present  a  new  approach  to  its  resolution  for  a  modal  of  single 
stage,  mu 1 1 i a 1 1 r i but *  decisionmaking  and  tradeoff  weight 
determination  under  risk.  The  model  considered,  a  generalization 
of  a  standard  decision  analysis  paradigm  (see  Keeney  and  Raiffa. 
1 9  7  6  j  sarin.  1977a.  bs  Whit*  at  al.>  1983).  allows  the 
decisionmaker  to  describe  the  value  or  possible  values  of  the 
tradeoff  weights  by  (1)  (possibly  imprecise)  tradeoff  weight 
assessment  and  (2)  directly  expressed  preferences  among  the 
alternatives.  Human  decisionmakers,  however,  occasionally 
produce  noncoherent  responses  in  judgmental  tasks.  This 
noncoherence  may  be  compounded  by  the  different  perspectives 
implied  by  the  above  two  approaches  to  tradeoff  weight 
determination.  As  a  consequence,  the  sat  of  all  tradeoff  weights 
that  can  satisfy  both  the  results  of  the  tradeoff  weight 
assessment  and  the  directly  expressed  preference  exercise  may  be 
null.  The  intent  of  this  paper  is  to  present  a  new  approach  to 
resolving  this  type  of  inconsistency. 


I.  PROBLEM  FORMULATION  AND  PRELIMINARIES) 

W*  assumes 

A  is  the  finite  set  of  alternatives. 

I  is  the  number  of  addltively  independent 
attributes. 

C  is  the  number  of  consequences. 

u  j,  g  ( a )  is  the  utility  associated  with 
alternative  i  of  selecting  alternative  a  and 
receiving  consequence  c. 

pc(a)  is  the  probability  of  receiving 
consequence  c.  given  that  alternative  a  was 
selected. 

wt  Is  the  tradeoff  weight  associated  with 
attribute  i. 

Let  w  -  row|w1,...,Wl|,  u( a )  -  |uic(a)).  and 

p(a)  «  col  ( pi.(a  ) . ...  «pc<  a  > )  •  Then. 


Multiple)  “5i-l  u>c(a,Pc(a> 


repreeents  the  expected  utility  of  selecting 
alternative  a.  Alternative  a'  is  said  to  be 
at  least  as  preferred  to  alternative  a  if  and 
only  if 


wu(a')pla’)  >  wu<a)p(a>. 


The  research  reported  has  been  supported  under 
OMR  Contract  N00014-80-C-0542 . 


Assume  p(a)  is  known  precisely  for  all  a 
A.  Let  w£vr  -  |w6Rl:wt  >  O.^w*  -  1) 
represent  the  set  of  all  possible  tradeoff 
weight  vectors,  a  set  presumably  derived  from 
information  provided  by  the  decisionmaker 
regarding  the  relative  importance  of 
attributes.  The  set  w  is  assumed  to  Jb* 
described  by  a  set  of  linear  inequalities  Sw. 

For  each  i.l»l..-.,I.  let  ut  represent 
the  set  of  all  possible  values  of  the  *AxC 
matrix  uj» ( ujc(a) )a,c»  where  *A  is  the  number 
of  elements  in  A.  we  assume  that  the  set  U^ 
is  derived  from  information  provided  by  the 
decisionmaker  regarding  alternative  and 
consequence  rankings  for  attribute  i. 
Typically,  the  Uj  will  be  described  by  sets 
of  linear  inequalities.  We  will  assume 
throughout  that  Uj  f  <t .  for  all  i-l,...,i. 
where  d  is  the  null  set. 

Let  the  information  provided  directly  by 
the  decisionmaker  regarding  the  relative 
desirability  of  the  alternatives  be  described 
by  the  relation  R  C  AxA.  where  (a', a)  R  if 
and  only  if  the  decisionmaker  has  stated  that 
alternative  a'  is  at  least  as  preferred  as 
alternative  a.  We  interpret  (a'.a)  R  to  mean 
that 


wu(a'lpla')  >  wu(a)p(a) 


for  all  possible  values  of  w.  u(a').  and 
u(a>.  Thus,  (a'.a)  R  implies  the  following 
restriction  on  the  tradeoff  weights) 


min  Vj(a'.a)  >0. 
ui€°i 


III.  INCONSISTENCY  RESOLUTION: 


wh«tt  Vjta',*)  -  [u1(a')p(a')  -  ut(a)p(a)]. 

and  u^(a)  -  (uic(a))c-  Ma  obaarva  that  If  UA 
la  daacrlbad  by  a  flnita  aat  of  linaac 
inequal it ies,  chan 


■In  v i ( a ' ,a ) 

Uieui 

la  a  Untar  program.  Let  SR  repreaant  tha 
aac  of  all  auch  linaar  Inaqualitiaa  generated 
by  Cha  orderad  pairs  In  R. 


Oafina  P  aa  tha  coaraaac  partition  of_  H 
generated  by  tha  Inaqualitiaa  in  S  -  §wusR. 

For  aach  P6P,  lat  S(  P )  $S  rapraaant  tha  aat 
of  inaqualitiaa  that  ara  violatad  by  tha  w  P. 
Ma  aay  that  S  is  consistent  ( inconsistent)  if 
there  exists  (does  not  exist)  a  P  P  such  that 
S(P)  -  gT.  That  lsi  S  is  consistent 
< 1  neons i a  tent )  if  there  is  (is  not)  a 
tradeoff  weight  in  w  for  which  no  inequality 
in  S  is  violatad.  Note  that  that*  can  ba  at 
most  ona  element  p€p  such  that  S(P)  •  d. 
Dafina  tha  relation  on  P  as  follows:  P'^  P 
if  and  only  if  S(P')  £  S(P).  Thus,  if  P> 

P,  then  aach  tradeoff  weight  vector  in  £ 
violates  at  least  as  many  inequalities  in  S 
as  any  of  tha  tradeoff  weight  vectors  in  P‘. 
we  illuminate  these  concepts  with  the 
following  example. 


II.  EXAMPLE: 


Assume  there  is  no  p£p  such  that  S(P)  ■ 
ff.  Than,  there  is  no  tradeoff  weight  in  Q 
that  satisfies  all  of  the  inequalities  in  S. 
Two  objectives  appear  reasonable: 

1.  Determine  a  tradeoff  weight  that 
minimizes,  in  some  sense,  the  ^extent  of 
violations  of  the  inequalities  in  S. 

2.  Request  that  the  decisionmaker 
reevaluate  preferences  associated  with  the 
Inequalities  in  s  with  the  hope  that  some  of 
the  inequalities  can  be  removed  or  modified 
in  order  to  produce  a  consistent  set  of 
Inequalities  and  associated  judgments. 

For  the  type  of  model  being  considered 
here,  linear  programming  procedures  like 
those  found  in  Pekelman  and  Sen  (1974)  can  be 
useful  in  helping  to  achieve  the  first 
objective.  The  difficulty  with  such 
procedures  is  that  the  criteria  may  not 
always  produce  behaviorally  justifiable 
results.  For  example,  consider  the  first 
model  presented  in  Pekelman  and  Sen  (1974): 


minimize  2. '  yk 
k-1 


subject  to  2.  a  ikw  i  ♦  Vk  >  °'  k-1 . . 


Consider  the  following  alternative 
selection  problem  under  certainty  (i.e.,  C  - 
1).  Assume  a  decisionmaker  wishes  to 
purchase  an  automobile  from  a  group  of  4 
automobiles  (A  -  (a ^ , ..., a4 ) ) .  selection  is 
to  be  based  on  3  attributes  (I  -  3):  safety, 
cost,  and  attractiveness.  The  lowest  level 
value  scores  are  shown  in  Table  1.  In  Table 
1,  1(0)  indicates  the  most  (least)  preferred 
alternative  for  a  specific  attribute.  The 
decisionmaker  states  a  preference  for 
automobile  aj  over  automobile  a^  l(«j,ajl£R) 
and  feels  that  in  the  context  of  the 
automobiles  under  consideration,  safety  is 
more  important  than  cost  and  cost  is  more 
Important  than  attractiveness;  that  ls,Sw  * 
(W1  >  w  2  .  w  2  >  w3  -  l_wl. - ''21- 

Straight  forward  analysis  shows  that  SR  -  f  - 
(S/2)Wj  ♦  1  >  Wj  ( •  ■  Thus,  S  -  (S/ZWj^  +  1 

>  w2,  «L  >  wj,  2 w 2  >  1  -  The  resulting 

partition  of  W  is  given  in  Figure  1 note 
that  P  -  (P1,...,P7).  The  elements  in  S(Pn). 
n**l,...»7»  are  presented  in  Table  2,  where 
Y(N)  indicates  that  the  inequality  is  in  (is 
not  in)  S(Pn).  For  example,  3(Pj)  «  ( 2wj  > 
The  resulting  domination  digraph  is 
presented  in  Figure  2.  We  note  that  S  is 
inconsistent  and  that  the  inconsistency 
exists  due  t.o  a  conflict  between  the 
inequality  in  SR  and  the  inequalities  in  3^. 
It  is  indicated  in  Table  2  and  Figure  2  that 
the  elimination  of  any  one  inequality  in  3 
will  produce  consistency. 


±w,  -  1 
i-1 

wi'  Vk  >  0 


where  K  is  the  number  of  inequalities  in  s 
end^j^.J  aik  Wj  >  t  is  the  kth  inequality  in 
S.  The  intent  of~solving  this  linear  program 
is  to  minimize  the  sum  of  the  y^,  where  y^ 
represents  a  measure  of  the  amount  of 
violation  of  the  kth  inequality.  Note  that 
if  the  optimal  criterion  value  is  zero,  then 
S  is  consistent.  Application  of  the  above 
linear  program  to  the  (inconsistent)  example 
presented  in  Section  2,  produces  the 
tradeoff  weights  w^  -  w7  -  2/7,  w3  •  3/7. 

However,  these  weights  indicate  that  Wj  <  uj, 
which  contradicts  the  decisionmaker's 
statement  that  cost  is  relatively  more 
important  than  attractiveness.  We  see  no 
behavioral  justification  for  contradicting 
this  statement  m  preference  to  contradicting 
any  other  stat  e_m  ent  associated  with 
inequalities  in  S.  Thus,  the  resulting 
solutions  of  such  approaches  cannot  be 
accepted  without  question. 

The  second  objective,  removal  or 
modification  of  an  inequality  in  S  requires 
that  the  decisionmaker  rethink  and  perhaps 
retract  a  former  statement  of  preference. 
Clearly,  it  is  behaviorally  desirable  to 
minimize  such  effort.  we  now  indicate  a 
procedure  for  identifying  minimal^  subsets  in 
S  which  if  removed  would  cause  3  to  become 
consistent . 


r 
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Lit  pNO  C  p  be  tht  iac  of  til 
nondominated  alamanea  of  P :  i.e.*  pgpND  if 
and  only  if  thaca  la  no  PGP  such  that  P*  ^  p 
and  not  P  ^»P'.  Obaarva  that  S  **  S(P)  <i.e., 
tha  aat  of,  all  tha  inequalities  In  S  axcapt 
thoaa  in  S(P>)  ia  consistent  for  any  P€  P. 
Nota>  however >„  that  if  PgP  la  dominated* 
thara  ia  a  P  '€  PND  auch  that  S<P')  £  S(P>. 

Thua>  it  ia  raaaonabla  to  investigate 
procaduraa  that  will  ramova  from  ,S  tha 
inequalities  in  StP)  for  any  of  tha  P  PND. 

Wa  now  present  a  procedure  ,lor 
identifying  t he,s ( p )  for  all  P«PND.  Lat  5  - 
J0.,1,}K.  and  lat  be  tha  aat  of  all  elemanta 
in*D  having  exactly_l  O’a  and  (K-l)  l'a.  For 

0  -  (dk,k.i . Kie'S.  consider  tha  linear 

program: 


0.  Sat  n-0. 

1.  tat  5,,-iOi . D„>*  where  s  aat 

m-  1  •  '  ' 

2.  Is  there  a  previously  identified  D* 
equivalent  to  3(P)  for  soma  p$PND  such  that 
Dm  <  d' ?  If  no>  go  to  3.  If  yes.  go  to  4. 

3.  Is  Dm  possibly  nondominated?  If  yes< 
save  Dm;  it  ia  equivalent  to  S(P)  for  soma  PG 
PND.  If  no*  go  to  4. 

4.  bat  m-m  +  1  if  n  <  Hi  and  go  to  2.  If 
m-N*  than  sat  n*n+l.  If  n  <  K*  than  go  to  1* 
If  n  >  K*  than  stop. 


K 

minimize  X 
k-l 


dkyk 


I 

subject  to  Z  wt  -  1« 
i-1 

w i .  y^  >  0  for  all  i  and  k< 
1 

X  aikwi*yk  -  0  £or  11  • 
i-1 

auch  that  dk«l 


With  respect  to  modifying  alamanta  in  s* 
we  have  noted  previously  that  more  precise 
assassmant  of  tha  Uj  causes  the  sat  of  all 
tradeoff  weights  satisfying  inequalities  in 
SR  to  enlarge.  Thus., more  precise  assassmant 
of  tha  Uk  may  causa  s  to  become  consistent. 
However*  thara  is  a  limit  as  to  how  much 
impact  mors  precise  assassmant  of  the  Uk  can 
have  on  tha  consistency  of  s.  To  determine 
this  limit*  lat  SR  represent  tha  sat  of  all 
linear  inequalities  of  tha  form 


£iwl  max  Vita*, a)  >  0* 
ui  0i 


or  equivalently* 


I 

Xaikwi  S  0  £or  al1  k 

i-1 

such  that  dk-0. 

Tha  sequence  D  for  the  above  linear  program 
is  said  to  be  possibly  nondominated  ifi 

1.  there  exists  a  feasible  solution* 

2.  the  optimal  criterion  value  equals  0* 

3.  the  slack  variables  for  the  dk-0 
inequalities  are  all  positive  in  the  first 
tableau . 

Observe  that  if  a  D  £o"  is  ,  possibly 
nondominated*  then  there  is  a  PgP  such  that 
5(P)  is  comprised  of  tha  inequalities 


I 

21  a  ikwk  0 


for  all  k  such  that  dk-0.  Note  that  if  D  and 
0‘  are  both  possibly  nondominated.  D  is 
associated  with  PgP.  O'  is  associated  with  p'$ 
P.  and  O'  <  0.  then  S(P)  C  3(P').,  Thus,  in 
searching  for  S(P)  for  all  P€ PND.  it  is 
sufficient  to  search  for  tha  sat  of  all 
possibly  nondominated  elements  in  6  that  are 
not  bounded  above  by  any  other  possibly 
nondominated  element  in  0.  We  now  present  an 
algorithm  for  this  search) 


Xiwi  min  vt(a,a')  <  0, 

ut  UJ 

for  all  ( a  ’ .  a  X;R .  Define  S  -  SRusu.  Then  if 
S  is  consistent*  more  precise  assessment  of 
the  Uj  may  produce  a  consistent  S-  If  3  is 
not  consistent*  then  more  precise  assessment 
of  the  Uj  alone  will  not  produce  a  consistent 
S-  For  example* ■  consider  ,the  example 
presented  in  Section  2.  Then*  SR  •  j-swj  ♦  2 
>w2f.  which  produces  the  partition  shown  in 
Figure  3.  The  tradeoff  weight  (1/3.  1/3.  1/31 
satisfies  all  inequalities  in  5 *  and  hence  S 
is  consistent.  However,  since  §  permits  only 
a  single  tradeoff  weight  satisfying  all 
inequalities*  it  is  unlikely  that  only  more 

precise  assessment  of  the  Ut  will  produce  a 
consistent  s. 


IV.  CONCLUSIONS: 

We  have  examined  a  model  of  single  stage 
d ec i s i o n m a k  i  n g  and  tradeoff  weight 
determination  under  risk  and  tradeoff  weight 
and  utility  score  imprecision  in  the  context 
of  inconsistency  resolution  with  respect  to 
tradeoff  weiqht  determination.  A  procedure 
for  identifying  the  minimal  sets  of 
inequalities  causing  inconsistency,  and  a 
method  for  determining  if  more  precise 
assessment  of  the  Uj  could  lead  to 
consistency,  were  given. 

The  results  presented  in  this  paper 
raise  an  interesting  behavioral  issue  if  Sw 
and/or  SR  is  inconsistent,  then  clearly  3  is 
inconsistent.  inconsistency  can  also  rasult 


3 


wh«n  «  consistent  Sw  ls  combined  with  a 
consistent  S^i  e.g.,  the  example  problem  in 
Section  2.  An  investigation  to 
determine  the  origins  of  and  behavioral 
explanations  for  inconsistency  ls  a  topic  for 
future  research.  Such  an  investigation  could 
be  expected  to  lead  to  interactive  procedures 
that  would  tend -to  reduce  inconsistency. 
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ABSTRACT 

We  present  a  dynamic  program  for  determining  the  set  of  all  possibly  optimal 
strategies  for  a  decision  analysis  problem  with  imprecisely  known  utility  function, 
where  imprecision  is  described  by  set  inclusion.  This  procedure  is  based  on  the 
assumption  that  the  utility  function  is  affine  in  an  unknown  parameter,  which  for 
example  might  he  the  vector  nf  utility  values  itself  o**  the  vector  of  importance 
weights.  A  simple  multiattribute  example  is  presented  to  Illustrate  the  theory 
and  the  computational  procedure. 

Keywords :  Decision  analysis,  parametric  dynamic  programming. 

INTRODUCTION 

The  standard  decision  analysis  (DA)  problem,  as  presented  in  Keeney  and  Raiffa 
(1976)  for  example,  assumes  that  various  outcome  probabilities  and  terminal  node 
utilities  are  known  precisely.  In  reality,  such  parameters  may  be  only  imprecisely 
known.  For  example,  the  decisionmaker  (DM)  may  find  precise  utility  assessment  too 
stressful  and/or  too  time  consuming  or  due  to  the  nature  of  the  problem,  the  DM 
may  wish  to  be  vague  about  his  preferences. 

F1skburn  11965),  Sarir  '1977a,  l?77b)t  and  White  et  el  (1982)  have  investi¬ 
gated  the  implications  of  parameter  imprecision  in  selecting  a  most  preferred  alter¬ 
native  for  a  single-stage  DA  problem.  Their  model  of  parameter  imprecision  was 
set  inclusion.  Cyert  and  DeGroot  (1975)  examined  a  sequential  decisionmaking  problem 
with  a  utility  function  dependent  on  unknown,  static  parameters.  A  Bayesian  esti¬ 
mate  of  the  utility  function  was  updated  at  each  decision  epoch  and  an  alternative 
selected  on  the  basis  of  this  estimate. 

In  this  paper,  we  examine  a  multi-stage  DA  problem  having  precise  probabilities 
but  imprecise  terminal  utility  values.  Utility  imprecision  is  described  by  set  in¬ 
clusion.  We  assume  that  knowledge  of  the  set  of  all  possible  terminal  utility  values 
does  not  change  over  the  planning  horizon;  thus  the  utility  function  is  static  and 
r.o  information  arrives  over  the  planning  horizon  to  revise  our  knowledge  of  the  set 
of  possible  utility  values. 

This  paper  is  organized  as  follows.  The  problem  is  formulated  in  Section  2, 
and  a  solution  procedure  is  derived  in  Section  3.  A  numerically  illustrative 


example  is  presented  in  Section  4.  Conclusion  and  directions  for  future  research 
are  presented  in  the  last  section. 

PROBLEM  FORMULATION 

Assume  that  the  given  decision  tree  has  a  maximum  of  K  stages.  For  simplicity, 
we  will  assume  that  all  branches  of  the  tree  have  exactly  K  stages,  which  can  be 
achieved  by  adding  the  appropriate  number  of  decision  nodes  with  single  actions  and 
chance  nodes  with  single  outcomes  to  branches  having  less  than  K  stages. 

Let  zk+i  be  the  outcome  received  after  having  selected  alternative, 
ak,  k=0,l,...,K-l.  Oefine  sk  «  {ag,z1,...,ak.1^k),  which  we  call  the  state  at  stage 
k.  Note  that  sk  uniquely  identifies  a  decision  node  in  the  decision  tree  if  k  <  K 
and  uniquely  identifies  a  terminal  node  in  the  decision  tree  if  k=K.  Assume  all 
probabilities  of  the  form  p(zk+1|sk,ak),  and  hence  p(sk+-| lsk,ak^’  are  known-  Let  SK 
be  the  set  of  all  terminal  nodes,  and  assume  u:$K-*R  is  the  utility  function  of  the 
problem.  The  DM  chooses  an  alternative  ak  at  stage  k  on  the  basis  of  the  stage  number 
k  ana  the  cuirenv  decision  node  sk;  thus,  4|(aX|c(s|c) »  where  X  «  {Xk,  k=0 ,1 ,. . . ,K-1 } 
is  referred  to  as  a  strategy.  Let  A  be  the  set  of  all  such  strategies.  Our  crite¬ 
rion  is  expected  utility,  Ex{u(sK)l.  Assume  all  that  is  known  about  u={u(sK),  s^cS^} 

u 

is  that  u  is  affine  in  an  imprecisely  known  parameter  p  and  that  pePCR  where  P  is 
a  given  set.  That  is,  u{sK)  *  h1  ( sR)  +  i h2 ( SK)n°n  *  h^sK^  +  h^s|()0»  where 
p  *  {pn,n«l,...,N}eP.  Our  objective  is  to  determine  the  set  of  all  strategies  that 
maximize  the  expected  utility  criterion  for  some  allowable  parameter  value.  That  is, 
we  seek  all  X  eA  such  that  for  some  peP 

Ex*[h1(sK)  +  h2(sK)pJ  >  Ex[h1(sK)  ♦  h2(sK)p] 

for  all  XeA. 

We  remarx  that  the  affine  form  of  the  utility  function  appears  to  allow  for  a 

wide  variety  of  interesting  problem  formulations.  For  example,  if  u  is  the  imprecise- 

#1  1 

ly  known  parameter,  then  N  «  S^,  h  (s^)  =  0,  and  h  (s^)  *  l  if  s^  *  n  (*  0  if  S^/n). 
As  another  example,  let  tl  represent  the  number  of  objectives  in  a  multicriteria  deci¬ 
sionmaking  problem  having  an  additive  utility  function  with  imprecisely  known  impor¬ 
tance  weights.  Then,  let  c  be  the  importance  weight  for  the  nth  objective,  and 
1  7  n 

define  h  (s)  and  lr(s)  appropriately. 

SOLUTION  PROCEDURE  _  .  . 

Dynamic  programming  will  be  used  to  achieve  the  problem  objective.  Let  f ^ (s ,c ) 
be  the  optimal  expected  utility  to  be  accrued  if  at  stage  k,  the  current  state  is  s 
and  the  value  of  the  imprecisely  known  parameter  is  p.  Then,  ffc  satisfies  the  fol¬ 
lowing  dynamic  programing  equation  and  boundary  condition: 
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Ms.;)  *  max  {£  p(s')|s,a)fk  ,(s' ,o)) 
k  acA^s)  s'  k+1 

1  2 

for  k  <  K,  where  f^( s,o)  ■  h  (s)  ♦  h  (s)p  and  where  Ak(s)  represents  the  set  of  all 
available  alternatives  at  stage  k,  given  that  the  decision  node  under  consideration 
Is  node  $  (Bertsekas,  1976).  Let  £  be  the  function  that  achieves  the  above  maximum, 
which  Is  a  function  of  stage,  state,  and  parameter  value.  That  is,  assume 
o  *  {ok,  k*0,l,...,K-l)  is  such  that 

fk(s,c)  *  I  p[s' |s ,dk(s ,p) Jfk+1 (s‘ ,p) 


for  all  k,  s,  and  o.  Then,  s  is  an  optimal  parameter  dependent  strategy  (Bertsekas, 
1976).  Note  that  if  X*  is  such  that  Xk(s)  »  6k(s,p)  for  all  k  and  s  for  some 
peP,  then  A  represents  one  of  the  (parameter  independent)  strategies  which  we  seek. 
Tli. »,  our  problem  object :7c  is  attained  onre  £,  and  hence  fk,  k*D,  ...K,  arc  deter¬ 
mined.  We  now  show  that  fk>  k*0,...,K,  has  a  computationally  interesting  functional 


Proposition.  For  each  k  and  s,  fk(s,c)  is  piecewise  affine  and  convex  in  p  on  P. 

Proof:  The  Proposition  equivalently  states  that  for  each  k  and  s,  there  is  a 
set  Ak(s)  of  pairs  (a.y)  such  that 

fk(s,o)  -  max  {a+yp:  (a.yJcA^s):, 

where  aeR  and  ycRN  for  any  (a,y)eAk(s).  Clearly,  f^ls.p)  is  piecewise  affine  and 
convex  in  o  for  each  s;  A^(s)  »  { (h^ (s),  h*(s))}.  Assume  for  each  (k+l)st  strge 
decision  node,  fk+1(s,o)  is  piecewise  affine  and  convex  in  p.  Then,  for  each  acAk(s), 

J  p(s'  |s,a)fk+1(s\o)  «  I  p(s '  |s,a)max{o+yp:(a,y)cAk+1(s’))  » 

max{£  p(s* ) | s .a)a(s ’ )  +  £  p(s ’ |s,a)y(s' )p), 
s'  s' 

where  the  last  maximum  is  taken  over  all  Ms'KyCs'JJeAi^U’)  for  all  states  s’  at 
stage  k+1.  Clearly,  the  right  hand  side  of  the  above  equality  string  is  piecewise 
affine  and  convex.  The  function  fk(s,p)  is  then  piecewise  affine  and  convex  since 
the  maximum  of  a  finite  number  of  piecewise  affine  and  convex  functions  is  piece- 
wise  affine  and  convex.  j  | 


403 


The  proof  of  the  Proposition  suggests  the  following  computational  procedure 
which  is  based  on  a  similar  procedure  found  in  (Smallwood  and  Sondik,  1973): 

0.  Define  AR(s)  *  { (h1 (s) ,  h2(s))};  set  k«K-l. 

1.  Define  A^s.a)  as  the  set  of  all  pairs  (a'.-f')  where 

a*  *  I  p(s‘ |s,a)a(s') 

S' 

r‘  *  I  Pis' |s,a)y(s‘) 
s' 

where  la(s‘),y(s‘))eAk^[S‘). 

2.  Define  Ak(s)  *  UaAs(s,a). 

3.  If  k=0,  stop;  if  not,  set  k*k-1  and  go  to  Step  1. 

We  remark  that  the  number  of  pairs  in  Ak(s,a)  may  be  reducible  by  eliminating  all 
pairs  \a',y')  in  Ak(s,a)  that  do  not  achieve  the  maximum  in  maxia’+y’p:  (a'.y'JeA^s.a) 
for  some  value  of  ptP.  An  analogous  statement  can  be  made  regarding  the  set  Akls). 

EXAMPLE 

We  now  present  a  simple  numerical  example  to  illustrate  the  theoretical  and  com¬ 
putational  results  obtained  above.  Consider  the  following  decision  tree: 


*  .  ••  'll 


2  a  u. 


*  .  'Vi 


1 ,  where: 


Let  u{ 


Ji1Jl 


+  ui2a2  + 


Ii303, 


°n  1  0  and 


n  *  1 

2 

3 

i  =  1 
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0.7 

0.75 

2 

0.8 
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0.85 
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0.2 

1 

0 

4 

0.35 

0 

0.75 

5 

0 

0.3 

1 

We  note  that  there  are  three  parameter  invariant  strategies: 

X^Ol)  *  ajj 

x2(01)  =  a^  and  ^(11)  *  a] 

x3(01 )  =  aj  and  x3(11)  =  a3 

The  boundary  conditions  and  the  first  iteration  of  the  dynamic  program  imply  that: 


f(21,p)  a  p-|  +  0.7p2  +  0.75pj 
f(22,p)  *  0.8p^  +  0.4pz  ♦  0.85c3 
f(23,p)  »  0.2p^  + 
f(24,p)  -  0.35Ol  +  0.75p3 
f(25,p)  ■  +  0.3o2  ♦  p3 

f(ll,p)  »  max{0.87p1  +  0.505d2  +  0.815p3>  0.2pj  +  p2> 
f(12,p)  =  0.35P|  ♦  0.75p2 
f(13,e)  *  0.3pj  +  pj 


12  2  1 
We  now  see  that  a^a^)  should  be  selected  rather  than  a^Uj)  if  0.87pj  +  0.505p2 

+  0.815p3  >  (<)  0.2oj  +  pg.  For  the  moment,  let  us  not  make  any  assumptions  regarding 

P.  Then, 


f(01,p)  «  max{0.3Ol  ♦  p3>  max{0.792p]  +  0.42925p2  +  0.80525p3,  0.2225p, 

♦  0.85p2  +  0.1125c3}), 

2  1  12 
where  a0(a0)  should  be  selected  rather  than  a^Ca^)  if  0.3d^  +  p3  >_  (<) 

max(0.792p1  ♦  0.4925c2  +  0.80525c3>  0.2225p1  +  0.85oz  +  0.112533).  We  note  that 

these  inequalities  divide  the  set  {peR3:  pp  >  0,  JnPn  *  1}  into  three  regions,  each 

of  which  represents  the  set  of  all  points  where  one  of  the  three  strategies  is  optimal. 

For  example,  if  all  that  is  known  about  o  is  that  >  pj  >  p3  and  Pj  »_  0.6,  then 
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,  1 

\  is  optimal.  As  another  example,  ifo3  >.0.85,  then  \  is  optimal.  We  remark  that 

if  ^0.6,  then  it  would  have  been  sufficient  to  let  f(ll,o)  *  0.87s1  +  0.505o2 

♦0.815s,. 

a 

CONCLUSIONS  AND  FUTURE  RESEARCH  DIRECTIONS 

We  have  presented  a  numerically  efficient  procedure  for  determining  the  set  of  all 
possibly  optimal  parameter  invariant  strategies  for  a  decision  analysis  problem  with 
imprecisely  known  utility  functions.  Future  research  directions  include  extending 
these  results  to  other  sequential  decisionmaking  problems  for  both  the  finite  and 
Infinite  planning  horizon  cases. 
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ABSTRACT 

This  paper  presents  a  discussion  and  interpretation  of  critical  factors  relevant  to 
the  design  of  support  systems  to  enhance  the  quality  of  organizational  decisionmaking. 
The  roles  of  information,  feedback,  and  individual  and  organizational  learning  in 
determining  choice,  and  the  organizational  objectives  that  lead  to  choice  and  that  are 
responsive  to  choice,  are  emphasized. 


1.  INTRODUCTION 

Information-based  technologies  are  major  potential  aids  to  organizational  decision¬ 
making.  Sound  design  and  implementation  of  information  and  knowledge  based  support 
to  oiganizational  decisionmaking  require  a  knowledge  of  the  ways  in  which  organizations 
can  acquire  and  process  information,  the  ways  in  which  organizations  adapt  to  their 
internal  and  external  environment,  the  ways  in  which  organizations  cope  with  conflict, 
the  ways  in  which  organizational  preferences  result  from  decisions  as  well  as  being 
determined  by  them,  and  the  ways  in  which  organizations  learn  and  fail  to  learn.  We 
discuss  each  of  these  in  this  paper  from  the  perspective  of  decision  support  system  design. 

2.  ORGANIZATIONAL  REALITIES 
There  are  a  variety  of  definitions  of  an  organization: 
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•  a  system  of  consciously  coordinated  activities  of  two  or  more  people  [6] 

•  social  units  deliberately  constructed  to  seek  specific  goals  [13) 

•  collectives  that  have  been  established  on  a  relatively  continuous  basis  in  an  environ¬ 
ment,  with  relatively  fixed  boundaries,  a  normative  order,  authority  ranks, 
communication  systems,  and  an  incentive  system  designed  to  enable  participants 
to  engage  in  activities  in  general  pursuit  of  a  common  set  of  goals  [15] 

•  a  set  of  individuals  (with  bounded  rationality)  engaged  in  the  decisionmaking 
process  [30] 

Organizations  can  be  viewed  from  a  closed  system  perspective  which  views  an 
organization  as  an  instrument  designed  to  enable  pursuit  of  well  defined  specified 
objectives.  In  this  view  an  organization  will  be  concerned  primarily  with  four  objectives: 
efficiency,  effectiveness,  flexibility  or  adaptability  to  external  environmental  influences, 
and  job  satisfaction  [16].  Four  organizational  means  or  activities  follow  from  this: 
complexity  and  specialization,  centralization  or  hierarchy  of  authority,  formalization  or 
standardization  of  jobs,  and  stratification  of  employment  levels  [16].  In  this  view, 
everything  is  functional  and  tuned  such  that  all  resource  inputs  are  optimum  and  the 
associated  responses  fit  into  a  well-defined  master  plan. 

March  and  Simon  [29],  among  others,  discuss  the  inherent  shortcomings  associated 
with  this  closed  system  model  of  humans  as  machines.  Not  only  is  the  human  as  machine 
view  inappropriate  but  there  are  pitfalls  associated  with  viewing  environmental  influences 
as  “noise.” 

In  the  open  systems  view  of  an  organization,  concern  is  not  only  with  objectives  but 
with  appropriate  respopses  to  a  number  of  internal  and  external  influences.  Weick  [50] 
describes  organizational  activities  of  enactment,  selection,  and  retention  which  assist  in 
the  processing  of  ambiguous  information  that  results  from  an  organization’s  interactions 
with  ecological  changes  in  the  environment.  The  overall  result  of  this  process  is  the  min¬ 
imization  of  information  equivocality  such  that  the  organization  is  able  to  understand  its 
environment,  recognize  problems,  diagnose  their  causes,  identify  policies  to  potentially 
resolve  problems,  evaluate  efficacy  of  these  policies,  and  select  a  priority  order  for 
problem  resolution.  Figure  1  presents  a  partial  interpretation  of  Weick’s  social  theory 
of  organizing. 

The  result  of  the  enactment  activities  of  the  organization  is  the  enacted  environment 
of  the  organization.  This  enacted  environment  contains  an  external  part,  which 
represents  the  activities  of  the  organization  in  product  markets,  and  an  internal  part 
which  is  the  result  of  organizing  people  into  a  structure  to  achieve  organizational  goals. 
Each  of  these  environments  is  subject  to  uncontrollable  ecological  influences  due  to 
economic,  social,  and  other  changes.  Selection  activities  allow  perception  framing, 
editing  and  interpretation  of  the  effects  of  the  organization’s  actions  upon  the  external 
and  internal  environments  such  as  to  enable  selection  of  a  set  of  relationships  believed 
of  importance.  Retention  activities  allow  admission,  rejection,  and  modification  of  the 
set  of  selected  knowledge  in  accordance  with  existing  retained  knowledge  and  integration 


4 


Policy  and  Information,  Vol.  7,  No.  2,  1983 


of  previously  retained  organizational  knowledge  with  new  knowledge.  There  are  a 
potentially  large  number  of  cycles  that  may  be  associated  with  enactment,  selection,_and 
retention.  These  cycles  generally  minimize  informational  equivocality  and  allow  for 
organizational  learning  such  that  the  organization  is  able  to  cope  with  very  complex  and 
changing  environments. 

We  shall  present  several  other  conceptual  models  of  organizations  in  other  sections  of 
this  effort.  A  very  important  feature  of  these  models  is  that  of  organizational  learning. 
Much  of  this  organizational  learning  is  not  necessarily  beneficial  or  appropriate  in  a 
descriptive  sense.  For  example,  there  is  much  literature  [23,35]  which  shows  that 
organizations  and  individuals  use  improperly  simplified  and  often  distorted  models  of 
causal  and  diagnostic  inferences,  and  improperly  simplified  and  distorted  models  of  the 
contingency  structure  of  environment  and  task  in  which  these  realities  are  embedded. 
Individuals  often  join  “groups”  to  enhance  survival  possibilities  and  to  enable  pursuit 
of  career  and  other  objectives.  These  coalitions  of  like  minded  people  pursue  interests 
that  result  in  emotional  and  intellectual  fulfillment  and  pleasure.  The  activities  that  are 
perceived  to  result  in  need  fulfillment  become  objectives  for  the  group.  Group  cohesion, 
conformity,  and  reinforcing  beliefs  often  lead  to  what  has  been  called  “groupthink" 
[20,21 1,  and  an  information  acquisition  and  analysis  structure  that  enables  processing 
only  in  accordance  with  the  belief  structure  of  the  group.  The  resulting  selective 
perceptions  and  neglect  of  potentially  disconfirming  information  preclude  change  of 
beliefs.  A  central  purpose  of  a  decision  support  system  is  to  enhance  the  knowledge  base 
for  decisionmaking  and  the  interpretation  of  this  knowledge  base  to  enhance  decision 
quality.  To  be  able  to  discuss  decisionmaking  as  it  might  be,  we  must  be  aware  of 
decisionmaking  and  judgement  and  choice  behavior  as  it  is. 


3.  ORGANIZATIONAL  MANAGEMENT 

An  important  aspect  of  the  study  of  organizations  is  the  role  of  management  and 
management  decisionmaking.  In  an  extraordinarily  insightful  work,  Mintzberg  [30] 
identifies  a  three-dimensional  taxonomy  that  characterizes  managerial  paradigms.  These 
paradigms  are  described  in  Table  1.  The  content  roles,  characteristic  roles,  and 
contingencies  which  influence  variations  in  managerial  efforts  are  obtained  from 
interpretation  of  the  results  of  the  decisionmaking  and  leadership  schools  of  thought 
concerning  managerial  behavior.  Mintzberg  has  identified  eight  schools  of  thought 
concerning  management,  as  indicated  in  Table  2.  The  information  roles  and  the 
decisional  roles  of  the  manager  are  of  particular  interest  here  as  well  as  the  contingency 
task  structure  variables  which  influence  these  roles.  Especially  relevant  to  our  efforts 
is  Mintzberg's  discussion  of  several  studies  of  managerial  activities  as  a  programmed 
system.  Tne  need  to  develop  programs,  or  cognitive  maps  [4,10],  or  process  tracing 
models  [22],  of  managerial  activity  is  an  essential  objective  in  the  development  of 
systems  that  support  management  and  organizational  decisionmaking. 
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4.  MODELS  OF  ORGANIZATIONAL  DECISIONMAKING 

The  organizational  science  literature  thoroughly  discusses  the  development  of 
conceptual  models  for  decisionmaking  by  individuals  and  by  organizations  based  upon 
various  rationality  conceptualizations.  Among  these  are:  the  (economic)  rational  actor 
model;  the  satisficing  or  bounded  rationality  model;  the  bureaucratic  politics, 
incremental,  or  “muddling  through”  model;  the  organizational  processes  model,  and  the 
garbage  can  model.  These  are  important  to  our  discussions  here  and  we  present  highlights 
of  each  of  these  models. 

a.  The  Rational  Actor  Model 

The  decisionmaker  becomes  aware  of  a  problem,  studies  it,  carefully  weighs 
alternative  means  to  a  solution  and  makes  a  choice  or  decision  based  on  an  objective  set 
of  values.  At  first  glance,  the  rational  actor  model  appears  to  contain  much  of  value. 
It  is  especially  well  matched  to  the  entrepreneurship  and  decision  theory  schools  of 
thought  as  described  by  Mintzberg.  However,  we  must  be  aware  that  it  is  a  normative 
substantive  model.  There  may  be  any  number  of  descriptive  process  realities  which  may 
make  it  infeasible  of  realization.  In  rational  planning  or  decisionmaking: 

1 .  The  decisionmaker  is  confronted  with  an  issue  that  can  be  meaningfully  isolated 
from  other  issues. 

2.  Objectives,  which  will  result  in  need  satisfaction,  are  identified. 

3.  Possible  alternative  activities  to  resolve  needs  are  identified. 

4.  The  impacts  of  action  alternatives  are  determined. 

5.  The  utility  of  each  alternative  is  evaluated  in  terms  of  its  impacts  upon  needs. 

6.  The  utilities  of  all  alternatives  are  compared  and  the  policy  or  activity  with  the 
highest  utility  is  selected  for  action  implementation. 

Simon  [39-43]  was  perhaps  the  first  to  observe  that  unaided  decisionmakers  may  not 
be  able  to  make  complete  substantive  use  of  the  economic  rational  actor  model  possible. 
The  concepts  of  bounded  rationality  and  satisficing  represent  much  more  realistic 
substantive  models  of  actual  decision  rules  and  practices.  Argyris  [  1  ]  has  presented  a 
definitive  recent  discussion  of  the  limits  to  rational  man  organizational  theory.  A  variety 
of  satisficing  heuristic  rules  have  been  described  in  [47],  These  are  often  used  as 
“simple”  substitutes  for  “difficult”  rational  behavior.  Unless  very  carefully  developed 
and  applied  however,  these  heuristic  rules  may  result  in  very  inferior  decisions;  decisions 
which  are  reinforced  through  feedback  and  repetition  such  as  to  result  in  experiences 
(and  learnings)  that  are,  by  no  means,  the  best  teacher.  Processes  that  are  only  economi¬ 
cally  rational  may  be  neither  desirable  nor  possible.  Social,  political,  or  legal  rationality 
concerns  may  well  prevail.  And  one  of  the  other  decision  frameworks  we  describe  here 
may  well  be  more  appropriate  if  these  concerns  are  dominant  over  economic  rationality 


concerns. 
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b.  The  Satisficing  or  Bounded  Rationality  Model 

The  decisionmaker  looks  for  a  course  of  action  that  is  basically  good  enough  to  meet 
a  minimum  set  of  requirements.  The  goal  is  to  “not  shake  the  system”  or  “play  it  safe” 
by  making  decisions  primarily  on  the  basis  of  short  term  acceptability  rather  than  seeking 
a  long  term  optimum. 

Simon  introduced  the  concept  of  satisficing  or  bounded  rationality  as  an  effort  to 
“. . .  replace  the  global  rationality  of  economic  man  with  a  kind  of  rational  behavior  that 
is  compatible  with  the  access  to  information  and  computational  capabilities  that  are 
actually  possessed  by  organisms,  including  man,  in  the  kinds  of  environments  in  which 
such  organisms  exist.”  He  suggested  that  decisionmakers  compensate  for  their  limited 
abilities  by  constructing  a  simplified  representation  of  the  problem  and  then  behaving 
rationaiiy  within  the  constraints  imposed  by  this  simplified  model.  We  may  satisfice  by 
finding  either  optimum  solutions  in  a  simplified  world  or  satisfactory  solutions  in  a  more 
realistic  world.  As  Simon  says,  “neither  approach  dominates  the  other”  [42] . 

Satisficing  is  actually  searching  for  a  “good  enough”  choice.  Simon  suggested  that 
the  threshold  for  satisfaction,  or  aspiration  level,  may  change  according  to  the  ease  or 
difficulty  of  search.  If  many  alternatives  can  be  found,  the  conclusion  is  reached  that  the 
aspiration  level  is  too  low  and  needs  to  be  increased.  The  converse  is  true  if  no  satisfactory 
alternatives  can  be  found.  This  may  lead  to  a  unique  solution  through  iteration. 

The  principle  of  bounded  rationality  and  the  resulting  satisficing  model  suggest  that 
simple  heuristics  may  well  be  adequate  for  complex  problem  solving  situations.  While 
satisficing  strategies  may  well  be  excellent  for  repetitive  problems  by  encouraging  one  to 
“do  what  we  did  last  time  if  it  worked  last  time  and  the  opposite  if  it  didn’t,”  they  may 
also  lead  to  premature  choices  that  result  in  unforeseen  disasterous  consequences; 
consequences  which  could  have  been  foreseen  by  ihore  careful  analysis.  A  paper  by 
Thomgate  [47]  provided  useful  descriptions  of  ways  in  which  heuristic  decision  rules 
may  be  used  and  abused.  Development  of  efficient  and  effective  decision  heuristics  is 
a  contemporary  need  for  the  analysis  of  decision  behavior  [8,47]  and  the  modeling  of 
organizational  and  individual  decisions  [34,45],  as  well  as  for  the  design  of  normative 
systems  to  aid  decisionmaking  [37] .  We  believe  that  to  be  effective  as  well  as  efficient, 
heuristics  will  have  to  be  developed  in  a  very  cautious  way  with  due  considerations  for 
the  many  implications  of  the  contingency  task  structure  of  a  decision  situation  [32,38]. 

c.  The  Bureaucratic  Politics,  Incrementalism,  or  " Muddling  Through  ”  Model 

After  problems  arise  which  require  a  change  of  policy,  policy  makers  typically 
consider  only  a  very  narrow  range  of  alternatives  differing  to  a  small  degree  from  the 
existing  policy.  One  alternative  is  selected  and  tried  with  unforeseen  consequences  left 
to  be  discovered  and  treated  by  subsequent  incremental  policies.  This  is  the  incremental 
view. 

In  1959,  Lindblom  postulated  the  approach  called  incrementalism,  or  muddling 
through  [26-28],  to  cope  with  perceived  limitations  in  the  economically  rational 
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approach.  Marginal  values  of  change  only  are  considered  —  and  these  for  only  a  few 
dimensions  of  value  —  whereas  the  rational  approach  calls  for  exhaustive  analysis  of  each 
identified  alternative  along  all  identified  dimensions  of  value.  A  number  of  authors  have 
shown  incrementalism  to  be  the  typical,  common,  and  currently  practiced  decision 
process  of  groups  in  pluralistic  societies.  Coalitions  of  special  interest  groups  make 
cumulative  decisions  and  arrive  at  workable  compromise  through  a  give  and  take  process 
that  Lindblom  calls  “partisan  mutual  adjustment.”  He  indicates  that  ideological  and 
other  value  differences  do  not  influence  marginal  decisions  as  much  as  they  influence 
major  changes  and  that,  in  fact,  considering  marginal  values  subject  to  practical 
constraints  will  lead  to  agreement  on  marginal  programs.  Further,  incrementalism  can 
result  in  agreement  on  decisions  and  plans  even  by  those  who  are  in  fundamental 
disagreement  on  values.  However,  incrementalism  appears  based  on  keeping  the  masses 
marginally  content  and  thus  may  not  be  able  to  do  much  to  help  the  greatly 
underprivileged  and  unrepresented.  There  have  been  a  number  of  studies  which  indicate 
incrementalism  to  be  an  often  used  approach  in  practice.  Without  doubt,  this  is  a  realistic 
process-oriented  descriptive  model. 

It  is  important  to  note  [26]  that  Lindblom  rejects  (economic)  comprehensive 
rationality  even  as  a  normative  model,  proposes  incrementalism  as  a  normative  approach,, 
and  indicates  that  systems  analysis  and  economic  rationality  will  often  lead  to 
ill-considered,  often  accidental  incompleteness.  He  indicates  the  following  inevitable 
limitations  to  analysis.  It  is  fallible,  never  rises  to  infallibility,  and  can  be  poorly 
informed,  superficial,  biased,  or  mendacious.  It  cannot  wholly  resolve  conflicts  of  value 
and  interest.  Sustained  analysis  may  be  too  slow  and  too  costly  compared  with  realistic 
needs.  Issue  formulation  questions  call  for  acts  of  choice  or  will,  and  suggest  that  analysis 
must  allow  room  for  politics. 

The  main  features  of  the  model  proposed  by  Lindblom  are  as  follows.  Ends  and 
means  are  viewed  as  not  distinct.  Consequently  means-ends  analysis  is  viewed  as  often 
inappropriate.  Identification  of  values  and  goals  is  not  distinct  from  the  analysis  of 
alternative  actions.  Rather,  the  two  processes  are  confounded.  The  test  for  a  good  policy 
is,  typically,  that  various  decisionmakers,  or  analysts,  agree  on  a  policy  as  appropriate 
without  necessarily  agreeing  that  it  is  the  most  appropriate  means  to  an  end.  Analysis 
is  drastically  limited,  important  policy  options  are  neglected,  and  important  outcomes 
are  not  considered.  By  proceeding  incrementally  and  comparing  the  results  of  each  new 
policy  with  the  old,  decisionmakers  reduce  or  eliminate  reliance  on  theory.  Ihere  is  a 
greater  preoccupation  with  ills  to  be  remedied  rather  than  positive  goals  to  be  sought. 
Incremental  analysis  is  a  good  description  of  political  decisionmaking  and  is  sometimes 
referred  to  as  the  “political  process”  model. 

d.  The  Organizational  Processes  Model 

Plans  and  decisions  are  the  result  of  interpretation  of  standard  operating  procedures. 
Improvements  are  obtained  by  careful  identification  of  existing  standard  operating 
procedures  and  associated  organizational  structures  and  determination  of  improvements 
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in  these  procedures  and  structures. 

The  organizational  process  model,  originally  due  to  Cyert  and  March  [12],  functions 
by  relying  on  standard  operating  procedures  which  constitute  the  memory  or  intelligence 
bank  cf  the  organization.  Only  if  the  standard  operating  procedures  fail  will  the 
organization  attempt  to  develop  new  standard  procedures. 

The  organizational  process  model  may  be  viewed  as  an  extension  of  the  concept 
of  bounded  rationality  to  choicemaking  in  organizations.  It  is  clearly  an  application  of 
reasoning  and  rationality,  as  discovery  and  application  of  rules,  to  cases.  There  are  four 
main  concepts  of  the  behavioral  theory  of  the  firm  which  are  suggested  as  descriptive 
models  of  actual  choice-making  in  organizations: 

(1)  Quasi-resolution  of  conflict.  Decisionmakers  avoid  conflicts  arising  from 
noncommensurate  and  conflicting  goals.  Major  problems  are  disaggregated  and  each 
subproblem  is  attacked  locally  by  a  department.  An  acceptable  conflict  resolution 
between  the  efforts  of  different  departments  is  reached  through  sequential  attention  to 
departmental  goals  and  through  the  formulation  of  coalitions  which  seek  power  and 
status.  When  resources  are  scarce  and  there  must  then  be  unsatisfied  objectives,  decisions 
concerning  allocations  will  be  met  largely  on  political  grounds. 

(2)  Uncertainty  avoidance  is  achieved  by  reacting  to  external  feedback,  by 
emphasizing  short  term  choices,  and  by  advocating  negotiated  futures.  Generally  there 
will  exist  uncertainties  about  the  future;  uncertainties  associated  with  future  impacts  of 
alternatives  and  uncertainties  associated  with  future  preferences.  Generally,  deficient 
information  processing  heuristics  and  cognitive  biases  are  used  to  avoid  uncertainties. 
The  effects  are,  of  course,  suboptimal. 

(3)  Problem  search  is  stimulated  by  encountering  issues  and  not  before  issues  are 
surfaced.  A  form  of  “satisficing”  is  used  as  a  decision  rule.  Search  in  the  neighborhood 
of  the  status  quo  only  is  attempted  and  only  incremental  solutions  are  considered. 

(4)  Organization  learning.  Organizations  adapt  on  the  basis  of  experience.  They 
often  pay  considerable  attention  to  one  part  of  their  environment  at  the  expense  of 
another. 

The  organizational  process  model  may  be  viewed  as  suggesting  that  decisions  at  time 
t  may  be  forecasted,  with  almost  complete  certainty,  from  knowledge  of  decisions  at 
time  t-T  where  T  is  the  planning  or  forecasting  period.  Standard  operating  procedures  or 
“programs,”  and  education  motivation  and  experience  or  “programming”  of  management 
are  the  critical  determinants  of  behavior  for  the  organizational  process  model.  Cohen  and 
March  recommend  a  strategy  of  management  leadership  to  cope  with  organizational 
process  realities.  Managers  are  encouraged  to  be  intimately  involved  in  organizations  such 
that  they  will  be  able  to  strongly  influence  decisions;  to  become  widely  informed  such 
that  they  will  be  highly  valued  in  the  information-poor  organization;  to  be  extraordinarily 
persistent  since  unmitigated  chutzpah  will  often  have  entirely  undeserved  rewards;  to 
encourage  those  with  opposing  views  to  participate;  and  to  overload  organizational 
systems  such  as  to  make  themselves  more  necessary.  In  this  view,  the  descriptive 
characteristics  of  the  organization  are  seen  as  performance  inhibiting  factors.  They  are 
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factors  not  to  be  overcome,  but  to  be  understood  and  used  to  the  advantage  of  the 
manager. 

e.  The  Garbage  Can  Model 

This  relatively  new  model  [11]  views  organizational  decisionmaking  as  resulting  from 
four  variables:  problems,  solutions,  choice  opportunities,  and  people.  Decisions  result 
from  the  interaction  of  solutions  looking  for  problems,  problems  looking  for  solutions, 
decision  opportunities,  and  participants  in  the  problem-solving  process.  The  model  allows 
for  these  variables  being  selected  more  or  less  at  random  from  a  garbage  can.  Doubtlessly, 
this  is  arealistic  descriptive  model. 

All  five  of  the  models,  or  frameworks,  for  decisionmaking  have  both  desirable  and 
undesirable  characteristics  and  any  of  them  may  be  relevant  in  specific  circumstances.  If 
we  accept  the  facts  that: 

1 .  Decisionmakers  use  a  variety  of  methods  to  select  among  alternatives  for  action 
implementation; 

2.  These  methods  are  frequently  suboptimal;  and 

3.  Most  decisionmakers  desire  to  enhance  their  decisionmaking  efficiency  and  effec¬ 
tiveness; 

then  we  must  conclude  that  there  is  much  more  motivation  and  need  for  research  and 
ultimate  design  and  development  of  planning  and  decision  support  systems.  But  these 
five  models  make  it  very  clear  that  improved  planning  and  decision-making  efficiency 
and  effectiveness,  and  aids  to  this  end,  can  only  be  accomplished  if  we  understand  human 
decisionmaking  as  it  is  as  well  as  how  it  might  be  and  allow  for  incorporation  of  this 
understanding  in  the  design  of  systemic  process  adjuvants.  One  of  the  requirements 
imposed  on  these  adjuvants  will  be  relevance  to  the  individual  and  group  decisionmaking 
structure.  Another  requirement  is  relevance  to  the  information  requirements  of  the 
decisionmaker.  Especially  important  also  is  accommodation  of  organizational  learning. 

5.  INFORMATION  PROCESSING  IN  ORGANIZATIONS 

We  are  particularly  interested  in  describing  the  decisionmaking  process  in  organiza¬ 
tions.  This  leads  naturally  to  a  study  of  information  processing  in  organizations  and  a 
description  of  how  decisionmakers  may  determine  information  needs.  While  there  have 
been  a  number  of  studies  of  group  decisionmaking  roles,  and  organizational  behavior 
[44,46],  our  efforts  will  be  based  primarily  on  those  of  Vroom  and  Yetton  [49],  Huber 
[17J,  and  Feldman  and  March  [  1 4  j . 

Huber  and  Vroom  and  Yetton  have  indicated  a  number  of  potential  advantages 
and  disadvantages  to  group  participation  in  decisionmaking.  Since  a  group  has  more 
information  and  knowledge  potentially  available  to  it  than  any  individual  in  the  group, 
it  should  be  capable  of  making  a  better  decision  than  an  individual.  Group  decisions  are 
often  more  easily  implemented  than  individual  decisions  since  participation  will  generally 
increase  decision  acceptance  as  well  as  understanding  of  the  decision.  Also  group 
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participation  increases  the  skills  and  information  that  members  may  need  in  making 
future  organizational  decisions.  On  the  other  hand,  there  are  potential  disadvantages 
to  groups.  They  consume  more  time  in  decisionmaking  than  individuals.  Their  decisions 
may  not  fully  support  higher  organizatonal  goals.  Group  participation  may  lead  to 
unrealistic  anticipations  of  involvement  in  future  decisions  and  resentment  by  individuals 
towards  subsequent  decisions  in  which  they  have  not  participated.  Finally,  there  is  no 
guarantee  that  the  group  will  converge  on  a  decision  alternative. 

Huber  asks  four  primary  questions,  the  answers  to  which  determine  guidelines  for 
selection  of  a  particular  form  of  group  decisionmaking.  These  concern  involving  others, 
encouraging  group  activities,  delegating  authority  to  the  group,  and  including  the  leader 
in  the  group.  The  responses  to  these  questions  determine  an  appropriate  form  of  group 
decisionmaking.  There  are  a  number  of  subsidiary  questions  concerned  with  each  of  the 
primary  questions.  For  example,  we  may  determine  whether  or  not  to  involve  others 
by  posing  questions  involving:  decision  quality,  understanding  and  acceptance,  personnel 
development  and  relationships,  and  time  required. 

Vroom  and  Yetton  have  been  very  concerned  with  leadership  and  decisionmaking 
[49].  Their  primary  concern  is  with  effective  decision  behaviors.  They  develop  a 
number  of  clearly  articulated  normative  models  of  leadership  style  for  individual  and 
group  decisions.  These  should  be  of  use  to  those  attempting  to  structure  normative  or 
prescriptive  models  of  the  leadership  style  portion  of  decision  situations  which  are 
capable  of  operational  implementation.  It  is  the  apparent  goal  of  Vroom  and  Yetton  to_ 
move  beyond  generalities  such  as  the  stereotypical  leadership  style  theory  X-theory  Y 
[25,49].  They  desire  to  come  to  grips  with,  and  use  explicitly,  leadership  behavior  and 
situational  variables  to  enhance  organizational  effectiveness.  Other  theories  and  practices 
of  organizational  leadership  are  presented  in  [7] . 

Keen  [24]  acknowledges  four  causes  of  inertia  relative  to  organizational  information 
systems.  •  He  indicates  that:  information  is  only  a  small  component;  human  information 
processing  is  experiential  and  relies  on  simplification;  organizatonal  change  is  incremental 
and  evolutionary  with  large  changes  being  avoided;  and  that  data  are  a  political  resource 
affecting  particular  groups  as  well  as  being  an  intellectual  commodity.  Each  of  these 
factors  suggests  the  importance  of  a  knowledge  of  the  way  in  which  information  is 
processed  by  organizations. 

The  purpose  of  knowledge-based  decision  support  systems  is  to  provide  timely, 
relevant,  and  accurate  information  to  system  users  to  enhance  human  judgement  and 
decisionmaking  efficiency  and  effectiveness  concerning  resource  allocations  that  affect 
issues  under  consideration.  Among  the  many  concerns  that  dictate  needs  and 
requirements  for  automated  support  systems  is  the  fact  that  decisionmakers  must 
typically  make  more  judgements  and  associated  decisions  in  a  given  period  of  time  than 
they  can  comfortably  make.  This  creates  a  stressful  situation  which  can  lead  to  the  use  ol 
poor  information  processing  and  judgemental  heuristics,  especially  since  judgements  and 
decisions  are  typically  based  on  forecasts  of  the  future.  Needs  and  issues  associated  with 
the  design  of  information  processing  and  judgement-aiding  support  systems  relate  to 
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questions  concerning  appropriate  functions  for  the  decisionmaker  and  staff  to  perform. 
They  concern  the  type  of  information  which  should  be  available  and  how  this 
information  should  be  acquired,  analyzed,  stored,  aggregated  and  presented  such  that  it 
can  be  used  most  effectively  in  a  variety  of  potential  operational  environments.  They 
concern  design  of  information  systems  with  strong  space-time-environmental 
dependencies.  They  concern  design  of  information  systems  that  can  effectively  “train” 
people  to  adapt  and  use  appropriate  concrete  operational  heuristics  in  those  environments 
in  which  inexperience  dictates  initial  use  of  formal  operational  thought.  They  concern 
design  and  use  of  information  systems  that  support  environmentally  experienced 
decisionmakers  in  the  use  of  a  variety  of  effective  concrete  operational  heuristics.  And 
because  of  their  use  by  multiple  decisionmakers,  these  tasks  must  be  accomplished  in  a 
parallel  architectural  fashion. 

Huber  [17-19]  and  Tushman  and  Nadler  [48]  have  developed  a  number  of 
propositions,  based  on  their  own  research  and  upon  the  research  of  others,  reflecting 
various  aspects  of  information  processing  in  organization.  The  general  conclusion  of 
these  studies  is  that  in  an  effort  to  enhance  efficiency,  organizational  information 
processing  typically  requires  selective  routing  of  messages  and  summarization  of  messages. 
In  the  classical  normative  theory  of  decisionmaking,  it  is  easily  shown  that  information 
about  the  consequences  of  alternative  courses  of  action  should  be  “purchased”  only  if  the 
benefits  of  the  information,  in  terms  of  precision,  relevance,  reliability  and  other  qualities 
exceed  the  cost.  Feldman  and  March  [14]  present  a  highly  symbolic  alternate  point  of 
view  in  their  descriptive  portrait  of  information  use  in  organizations.  Their  discussions  of 
information  incentives  indicate  systematic  bias  in  estimating  the  benefits  and  costs  of 
information  due  to  the  fact  that  the  costs  and  benefits  do  not  occur  at  the  same  place  and 
at  the  same  time  such  that  one  group  has  responsibility  for  information  use  whereas 
another  has  responsibility  for  information  availability.  Also,  people  are  prone  to  obtain 
more  informaton  than  is  needed  since,  under  uncertainty  conditions,  the  post  outcome 
probabilities  of  events  that  do  occur  will  be  (descriptively)  judged  higher  than  the  prior 
probabilities  of  these  events.  This  will  suggest  that  less  information  was  obtained  than 
should  have  been  obtained.  This  will,  typically,  lead  to  incentives  to  obtain  too  much 
information. 

Feldman  and  March  also  indicate  that  much  of  the  information  that  is  obtained  is 
obtained  for  surveillance  purposes  to  uncover  potential  surprises  rather  than  to  clarify 
uncertainties  for  decisionmaking.  Strategic  misrepresentation  of  information,  due  to 
interpersonal  conflicts  and  power  struggles,  is  a  third  factor  suggested  as  decoupling 
information  gathering  from  decisionmaking.  This  occurs  since  information  is  not 
innocent  and  must  be  suspected  of  bias.  Finally,  information  is  a  symbol  which  indicates 
a  commitment  to  rationality;  and  there  are  incentives  to  displaying  the  incentive  even  if 
it  is  not  used. 

Identification  of  other  variables  which  influence  information  processing  in  and  by 
organizations  would  represent  a  desirable  activity.  To  determine  how  these  information 
processing  variables  are  influenced  by  the  information  processing  biases  of  individuals 
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discussed  in  [23,35]  would  seem  especially  desirable  in  terms  of  the  likely  usefulness  of 
the  results  and  the  need  for  an  expanded  theory  of  group  information  processing  biases. 
There  appear  to  have  been  only  limited  results  obtained  in  the  area  of  cognitive 
information  processing  biases  and  use  of  inferior  heuristics  on  the  part  of  groups.  The 
development  of  appropriate  normative  strategies  for  information  requirements  determina¬ 
tion  are  especially  important  towards  these  ends.  Davis  [9]  identifies  two  major  levels 
of  requirements:  the  organizational  information  requirements  reflected  in  a  planned 
applications  portfolio,  and  detailed  information  requirements  associated  with  specific 
applications.  A  contingency  approach  is  suggested  to  yield  information  requirements 
at  each  level  and  to  minimize  the  deficiencies  associated  with  human  information 
processing. 

A  major  difficulty  in  cognitive  information  processing  seems  to  be  failure  to  identify 
and  use  an  appropriate  structure  that  allows  appropriate  weighting  of  observed  data. 
Investigation  of  the  effects  of  various  structured  information  processing/decision  aiding 
protocols  upon  the  acquisition,  analysis,  and  interpretation  of  informaton  and  its 
integration  with  judgment  and  decisionmaking  activities  would  appear  to  be  a 
contemporary  need  in  information  system  design.  There  are  a  number  of  studies  in 
expert  systems  and  artificial  intelligence  [5]  relevant  to  these  ends.  These  and  other 
studies  may  well  provide  a  structured  framework  for  information  processing  styles  and 
approaches  ranging  from  the  purely  qualitative  and  affective,  to  reasoning  by  analogy 
which  may  be  a  blend  of  qualitative  and  quantitative,  to  quantitatively  based  filtering  and 
detection  algorithms. 

6.  ORGANIZATIONAL  LEARNING 

Organizational  learning  results  when  members  of  the  organization  react  to  changes  in 
the  internal  or  external  environment  of  the  organization  by  detection  and  correction  of 
errors  [1-3].  An  error  is  a  feature  of  knowledge  that  makes  action  ineffective  and 
detection  and  correction  of  error  produces  learning.  Individuals  in  an  organization  are 
agents  of  organizational  action  and  organizational  learning.  The  seminal  theory  of  action 
concept  of  Argyris  [1-3]  is  based  upon  these  notions  which  are  extraordinarily  relevant 
to  decision  support  system  design. 

Argyris  cites  two  information  related  factors  that  inhibit  organizational  learning: 
the  degree  to  which  information  is  distorted  such  that  its  value  in  influencing  quality 
decisions  is  lessened,  and  lack  of  receptivity  to  corrective  feedback.  Two  types  of 
organizational  learning  are  defined.  Single  loop  learning  is  learning  which  does  not 
question  the  fundamental  objectives  or  actions  of  an  organization.  Members  of  the 
organization  discover  sources  of  error  and  identify  new  strategic  activities  which  might 
correct  the  error.  The  activities  are  analyzed  and  evaluated  and  one  or  more  selected  for 
implementation.  Environmental  control  and  self  protection  through  control  over  others, 
primarily  by  imposition  of  power,  are  typical  strategies.  The  consequences  of  this 
approach  include  defensive  group  dynamics  and  low  production  of  valid  information. 
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The  lack  of  information  does  not  result  in  disturbances  to  prevailing  values.  The  resulting 
inefficiencies  in  decisionmaking  encourage  frustration  and  an  increase  in  secrecy  and 
loyalty  demands  from  decisionmakers.  All  of  this  is  mutually  self  reinforcing.  It  results 
in  a  stable  autocratic  state  and  a  self  fulfilling  prophecy  with  respect  to  the  need  for 
oiganizational  control. 

Double-loop  learning  involves  identification  of  potential  changes  in  organizational 
goals  and  of  the  particular  approach  to  inquiry  that  allows  confrontation  with  and 
resolution  of  conflict  rather  than  the  translation  of  incompatible  objectives  into 
intergroup  conflict.  Not  all  conflict  resolution  is  the  result  of  double  loop  learning 
however.  Good  examples  of  this  are  conflicts  settled  through  imposition  of  power  rather 
than  inquiry.  Thus,  double-loop  learning  is  seen  to  be  the  result  of  that  organizational 
inquiry  which  resolves  initially  perceived  incompatible  organizatonal  objectives  through 
the  restructuring  and  setting  of  new  priorities  and  objectives.  New  understandings  are 
developed  which  result  in  updated  cognitive  maps  and  scripts  of  organizational  behavior. 
Organizations  are  claimed  to  learn  primarily  on  the  basis  of  single  loop  learning  and, 
typically,  do  not  engage  in  double-loop  learning. 

Individuals  act  as  agents  of  organizational  learning  through  the  processing  of  initially 
inaccessible  and  obscure  information  and  by  resolving  potential  inadequacies  associated 
with  individual  and  organizational  theories  of  action  [2].  All  human  action  is  said  to 
be  based  on  theories  of  action.  There  are  two  types:  espoused  theories  of  action,  which 
are  the  “official”  theories  that  people  claim  as  a  basis  for  action;  and  theories  in  use, 
which  are  the  descriptive  theories  of  action  that  may  be  inferred  from  actual  behavior. 
While  people  are  often  adept  at  identifying  discrepancies  between  espoused  theories  of 
action  and  theories  in  use  associated  with  others,  they  are  not  equally  capable  at  self 
diagnosis.  However  people  are  programmed  with  theories  in  use  that  suggest  that  this 
inconsistent  behavior  in  others  not  be  reported  to  them  by  those  who  detect  it.  So  we 
see  again  the  presence  of  social  exchanges  and  customs  that  inhibit  double  loop  learning. 

There  are  several  dilemmas  associated  with  theory  of  action  building  [3].  Among 
these  non-mutuaUy  exclusive  dilemmas,  which  result  in  conflicting  and  intolerable 
pressures,  are: 

•  incongruity  between  espoused  theory  and  theory  in  use  which  are  recognized  but 
not  corrected 

•  inconsistency  between  theories  in  use 

•  ineffectiveness  as  objectives  associated  with  theories  in  use  become  less  and  less 
achievable  over  time 

•  disutility  as  theories  in  use  become  less  valued  over  time 

•  unobservability  as  theories  in  use  result  in  suppression  of  information  by  others 
such  that  evaluation  of  effectiveness  becomes  impossible. 

Detection  and  correction  of  inappropriate  espoused  theories  of  action  and  theories 
in  use  is  suggested  as  potentially  leading  to  a  reduction  in  those  factors  that  inhibit 
double-loop  learning.  Of  course  single-loop  learning  often  will  be  appropriate.  The 
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result  of  double-loop  learning  is  a  new  set  of  goals  and  standard  operating  policies  that 
become  a  part  of  the  organization’s  knowledge  base.  It  is  when  the  environment,  or  more 
generally  the  contingency  task  structure,  changes  that  double-loop  learning  is  called  for. 
Inability  to  accommodate  double-loop  learning  is  a  flaw.  Ability  to  successfully  integrate 
and  utilize  the  appropriate  blend  of  single  and  double  loop  learning  is  called  deutero, 
or  dialectic,  learning. 

Several  intervention  models,  or  approaches,  are  suggested  to  encourage  organizations 
to  adopt  a  capability  for  double-loop  learning  [3].  These  include  comprehensive  inter¬ 
vention;  limited  intervention  through  structural  mapping  of  the  issue,  internalization  of 
the  map,  testing  and  validation  of  the  map,  simulation  and  analysis  of  impacts  using  the 
map,  and  generation  of  knowledge  using  the  map  for  use  in  future  designs;  and  several 
partial  models  of  intervention.  Of  particular  interest  in  this  seminal  work  are  the  several 
caveats  given  concerning  difficulties  in  the  design  of  management  information  and 
decision  support  systems  such  that  they  support  Model  II  (i.e.,  double-loop)  learning, 
rather  than  Model  I  (single-loop)  learning. 

7.  SUMMARY 

We  have  presented  a  description  and  interpretation  of  some  recent  results  in 
behavioral  and  organizational  theory  that  have  direct  relevance  to  the  design  of 
information  systems  to  aid  the  human  decisionmaker  in  organizational  settings.  The 
primary  organizing  principles  in  organizations  include:  division  of  labor  and  task  assign¬ 
ment,  identifying  standard  operating  principles,  top  down  flow  of  decisions,  formal  and 
informal  channels  of  communication  in  all  directions,  the  multiple  uses  of  information, 
and  organizational  learning.  We  must  be  conscious  of  these  descriptive  principles  in  order 
that  we  be  able  to  produce  normative  aids  that  are  realistically  grounded  in  the  realities 
of  human  desires  and  capabilities  for  growth  and  self  actualization. 
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An  Interactive  Procedure  for  Aiding  Multiattribute 
Alternative  Selection1 


INTRODUCTION 

In  this  paper.  »c  examine  a  procedure  for  aiding  a 
decisionmaker  in  the  task  of  selecting  a  single  alternative 
from  a  finite  set  of  muhiaitributed  alternatives  in  an 
uncertain  environment.  Key  characteristics  of  this  pro¬ 
cedure  are:  it  is  interactive  and  it  attempts  to  reduce  the 
number  and  precision  of  probability,  importance  weight 
and  utility  values  necessary  for  alternative  ranking, 
thereby  reducing  the  time,  stress  and  effort  required  by 
the  decisionmaker  to  use  it.  The  procedure  essentially 
strengthens  and  extends  results  in  [2. 3]  and  compliments 
resuits  in  [5]. 


PROBLEM  FORMULATION 

The  decisionmaker's  objective  is  to  select  a  preferred 
alternative  from  A  available  alternatives.  Once  an  alter- 
ra'.ive  is  seiectrd,  one  of  C  consequences  vill  rcc  r.  If 
alternative  a  is  selected,  consequence  c  will  occur  with 
probability  p,{a)  and  utility  u,(a)  with  respect  to  attri¬ 
bute  i,  i  —  1 .... ,  /.  We  assume  that  expected  utility 
ranks  the  alternatives  in  a  manner  consistent  with  the 
decisionmaker's  preferences.  If  the  attributes  are  addi¬ 
tive  independent  [I, p. 295].  then  expected  utility  of 
alternative  a  is 

i  c 

I  X  **  *u(a)p(a\ 

«•!  **» 

where  h4  ^  0  is  the  importance  weight  of  attribute  /, 

X  Hi=  *• 

Im  I 

Thus,  alternative  a'  is  (weakly)  preferred  to  alternative 
a  if  and  only  if  nu(a')p(a')  ;>  n u(a)p(a). 

Let  A  (o  \  o)  represent  the  set  of  all  possible  values  that 
the  5-tuple  {«-.  u(o'),  «(«),  p(a').  p(a))  can  assume.  The 
set  A(o',  a)  represents  a  description  of  parameter  value 
imprecision  and  is  assumed  to  be  given  for  every  alterna¬ 
tive  pair  (o', a).  We  remark  that  if  A'(o'.o)  £  A(o\ a), 
then  A '(o',  o)  represents  more  information  about  the 
parameter  values  than  does  A  (o',  a)  but  is  presumably 
more  difficult  to  assess  than  is  A  (o',  a). 

Define  the  relation  R  on  the  alternative  set  as  follows: 
(a'.a)eR  if  and  only  if  nu'p'  £  wup  for  all 
(«’.  u'.  u.p',p)e  A(o',  a).  Thus  (o',  a)  6  R  if  and  only  if 
alternative  a'  is  preferred  to  alternative  a  for  all  possible 
values  of  the  parameters.  Hence.  R  represents  a  descrip¬ 
tion  of  preference  on  the  alternatives  in  a  manner 
consistent  with  the  expected  utility  criterion  and  the  set 
of  all  possible  parameter  values  and  as  such  represents 
a  potentially  key  source  of  alternative  selection  support. 
For  example,  if  a*  is  such  that  there  is  no  o'  such  that 
(o',  a*) €  R  and  (a*.  a')(  R,  then  a"  is  nondominated.  If 
a*  is  such  that  (a*. a)e  R  and  (a.a,)i  R  for  all  a  #  a*, 
then  a*  is  the  most  preferred  alternative.  Our  objective, 
therefore,  is  to  determine  R ,  given  A(a a )  for  all  (o a). 

1  This  research  fiu*  been  supported  by  ONR  Contract 
N000l-4-M)-C-05-t2,  work  unit  number  N197-065. 


Note  that  (o',  a) e  R  if  and  only  if 

min  te [u (a ’)/> (a ')  —  u (a )/> (a )]  (I) 

All .  f| 

is  nonnegative.  Conditions  on  A  (o’,  a)  which  guarantee 
that  R  is  transitive  for  a  slightly  more  general  problem 
can  be  found  in  the  appendix  of  [5];  we  will  assume  that 
R  is  transitive  throughout  this  paper. 


DETERMINATION  OF  R 

The  key  to  determining  or  approximating  R  is  solving 
or  bounding  the  mathematical  program  presented  in  (I). 
We  now  present  two  cases  where  (I)  can  be  solved 
exactly  and  one  case  where  (I)  can  be  bounded  from 
below.  Consideration  of  the  first  two  cases  has  been 
motivated  by  results  in  [2]. 

Coiv  1 

Assume  p(o')  and  p(a)  are  known  precisely,  «•  e  IF, 

and  Uj «  eU„i-\ . I-  Let  u,(o)  =  {i<„(o)},. 

Then,  (1)  becomes 

min  min  . . .  min  Y  w\u,(a‘)p{a') 

•  I  M  ail  ll  1/f  If  T* 

-u,(a)p(a) ) 

«  min  Y  w,  min  [u,(<7  ')p  (fl  ') 

% «  W  *  U 

-u,(a)p(a)). 

Let 

r .(o',  o)  =  min  \u,(a')p(a')  -  u,(n)/r(a)]. 

*«ii 

Then,  ( a',fl)e  R  if  and  only  if 

min  Y  c)  >  0.  (2) 

T 

We  observe  that  if  U,  is  described  by  linear  inequalities 
(a  common  way  of  describing  interval  estimates  and/or 
ordinal  ranking*),  then  the  determination  of  r,(o',o)  can 
be  accomplished  by  a  linear  program.  If  IF  is  described 
by  linear  inequalities,  then  once  e,(fl',  a)  has  been  deter¬ 
mined  for  all  f «  1 . /,  (2)  can  be  determined  by  a 

linear  program.  If  IF  and  £/,.  for  all  /,  are  all  described 
by  linear  inequalities,  then  R  can  be  constructed  by- 
solving  A  (A  —  I)/  linear  programs  to  determine  the 
t.V(a',  o)  and  then  solving  A  (A  —  1 )  linear  programs  to 
determine  the  solutions  of  (1).  We  remark  that  the 
necessary  and  sufficient  condition  for  an  alternative  to  be 
the  most  preferred  for  all  possible  parameter  values, 
given  in  (2),  represents  an  upper  bound  on  the  first  two 
sufficient  conditions  given  in  the  appendix  in  [2]. 

Core  2 

Assume  »  is  known  precisely.  [p(a’).p(o))  eP(a',a) 
and  w,e  l'„  i  **  I . /.  and  let 

u,(o)  -  max  w,(o) 

£r(o)  =  min  i/,(n). 
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Table  1.  Alternative  ranking  and  weights  Table 


Attribute 

Weight 

1 

Aliernativc 

2 

3 

4 

1 

0.3 

4(0.5)  3(0.5) 

2(0.4)  1(0.6) 

5 

3(0.8)  2(0.2) 

2 

0.2 

2 

3(0.5)  5(0.5) 

4 

2(0.6)  4(0.^) 

3 

0.05 

2 

5 

1 

1  i 

4 

0.15 

1 

3 

5 

1 

5 

0.2 

3 

4(0.5)  5(0.5) 

4 

2 

6 

0.1 

2 

3(0.5)  1(0.5) 

4 

5 

Then,  it  is  easily  shown  that  (1)  is  bounded  from  below 
by 

min  jx  »•,**(«■)/» (o')  —  X  *\u,(a)p(a^.  (3) 

Clearly,  if  (3)  is  nonnegative.  then  (o',  a)  eft,  and  hence 
we  have  a  sufficient  (but  not  necessary)  condition  for 
(o',  o)6  R.  We  remark  that  the  sufficient  condition  given 
in  (3)  represents  an  upper  bound  on  the  third  sufficient 
condition  given  in  the  appendix  in  (2). 

Case  3 

Assume  u(a'),  and  u(a)  are  known  precisely  and 
{p(a‘).p(a)}e  P(a',a).  Then,  (1)  becomes 

min  f«-u'(o)p'  —  mt(a)p] 

ta»t  **'•*>  r 

which  is  a  linear  program  if  P(a\a)  is  described  oy 
linear  inequalities. 

AN  INTERACTIVE  PROCEDURE 

We  now  present  an  interactive  procedure  for  solving 
the  problem  posed  in  Case  1.  Analogous  procedures  are 
easily  developed  for  Cases  2  and  3.  This  procedure  is 
based  on  the  following  three  general  steps  for  interactive 
derision  aiding  IS]: 

(a)  Eliminate  as  many  alternatives  as  possible  using 
currently  available  parameter  value  information. 

(b)  If  an  alternative  can  be  selected  without  further 
alternative  elimination,  then  stop. 


Table  2.  Probabilities  and  unurr  rankings 
?.(o)  \ 


c 

1 

a 

2 

3 

4 

1 

0.5 

0 

0 

0 

2 

0.5 

0 

0 

0 

3 

0 

0.4 

0 

0 

4  . 

0 

0.1 

0 

0 

5 

0 

0.5 

0 

0 

6 

0 

0 

1 

0 

7 

0 

0 

0 

0.6 

8 

0 

0 

0 

0.2 

9 

0 

0 

0 

0.2 

“.(a) 

Alternative 

l 

2 

3 

4 

Consequence 

1 

1  2 

3 

4  5 

6 

7 

8  9 

1 

4  3 

2 

1  1 

5 

3 

3  2 

2 

2  2 

3 

3  5 

4 

2 

4  4 

3 

2  2 

5 

5  5 

1 

1 

1  1 

4 

1  1 

3 

3  3 

5 

1 

1  1 

5 

3  3 

4 

4  5 

4 

2 

2  2 

6 

2  2 

3 

3  1 

4 

5 

5  5 

(c)  If  a  choice  cannot  be  made,  then  assess  further 
information  about  the  values  of  the  imprecisely 
known  parameters  and  return  to  Step  a. 

These  three  steps  applied  to  Case  I  pr  duce  the 
following  iterative  procedure: 

(0)  Assess  p(a)  for  all  a,  IP,  and  V,  for  all  f. 

(1)  Determine  c,(a‘,a)  for  all  /.  o',  and  a.  o'  #o. 

(2)  Construct  R  from  the  solutions  of  (2). 

(3)  If  R  provides  sufficient  information  for  alternative 
selection,  then  slop.  If  not.  go  to  Step  4. 

(4)  Assess  further  parameter  value  information.  If  the 
new  information  only  affects  H',  then  go  to  Step  2. 
If  the  new  information  affects  any  U„  then  go  to  Step 
I. 

Noting  Step  4.  we  obsetvi  tha’  i.*tl  e  nev  in**,  mciu.n 
assessed  only  affects  the  importance  weights,  then  need 
for  redetermining  the  i,(o,a),  and  hence  for  solving 
A(A  —  1)/  linear  programs,  is  eliminated.  This  fan  may 
affect  the  direction  of  the  assessment  procedure  if  inter¬ 
active  time  is  important  and  if  the  solution  of  the  linear 
programs  required  to  determine  the  r,(a'.  a)  is  time 
consuming. 

AN  ILLUSTRATIVE  EXAMPLE 

We  now  re-examine  the  juvenile  drug  treatment  and 
rehabilitation  problem  presented  in  f2]  using  the  iterative 
procedure  presented  above.  For  this  problem  A  =  4  and 
/  =  6.  Tables  1  and  1  present  the  initially  relevant 
information.  Note  that  the  importance  weights  are  as¬ 
sumed  to  be  known  precisely.  All  utility  scores  are 
ordinal  rankings  with  k  +  I  being  more  desirable  than  k. 
T!  e  figure:  in  tareniheses  in  Tab'e  I  reprerent  the 
probability  of  obtaining  the  ranking  to  the  left  of  the 
parentheses.  For  example,  the  probability  of  receiving  a 
ranking  of  3  with  respect  to  attribute  1  if  alternative  4 
is  chosen  is  0.8.  In  order  to  model  the  consequences, 
we  assume  C  «  9  and  define  the  p,(a)  and  ur(a)  as  in 
Table  2.  We  interpret  the  matrix  entries  in  Table  2 
concerning  the  t/„(a)  to  be  rankings.  For  example,  for 
attribute  i  =  1  we  interpret  the  rankings  to  imply 
0  =  u,.(2)  =  u,«(2)  £  u,j(2)  =  u„(4)  £  «,,<!)  »  up(4)  = 
«u(4)  £  v,,(l)  £  u,e(3)  =  1,  which  defines  U ,  in  terms  of 
a  finite  set  of  linear  inequalities. 

Based  on  the  information  contained  in  Tables  1  and 
2,  the  interactive  procedure  (approximately  simplified 
due  to  the  fact  that  H'  is  a  singleton)  produced 
R  =  {(3, 1).  (3,4)}.  Thus,  alternative  3  dominates  alter¬ 
natives  1  and  4,  leaving  alternatives  2  and  3  as  con¬ 
tenders  for  the  most  preferred.  If  the  decisionmaker 
prefers  2  to  3  or  3  to  2.  then  according  to  the  interactive 
procedure,  the  alternative  selection  process  can  stop  (see 
[4]  for  an  alternative  approach).  If  not.  more  parameter 
information  would  require  assessment  in  order  to  reduce 
the  nondominaled  set  '12.  '•]■  In  [2],  additional  parameter 
value  information  was  iierati'dy  added  to  the  informa¬ 
tion  contained  in  Table  2  with  regard  to  the  u,(c).  The 
impact  of  this  information  on  the  relation  R  using  our 
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Table  3.  [Dominance  structures 


Additional 

information 

R 

none 

■1(3.1).  (3.4)} 

«„(l)  =  0.s 

,'(3. 1).  (3;  4)} 

u,.(l)  =  0.7 

1(3. 1).  (3. 4)} 

«„(2)  =  0.2 

1(3.1).  (3. 2).  (3. 4)} 

u-i(2)  =  0.2 

1(3.1),  (3. 2).  (3, 4)} 

u.((3)  =  0.8 

1(3.  1).  (3, 2).  (3, 4)} 

approach  is  presented  in  Table  3.  For  example,  if  it  is 
known  that  u„(l)-0.8,  u,;(l) - 0.7  and  u„(2)  =  0.2, 
then  R  m  {(3.  I).  (3,2),  (3,4)}.  indicating  that  alternative 
3  is  the  most  preferred.  We  note  that  further  additional 
information  does  not  alter  the  relation. 

The  approach  taken  in  [2]  indicated  that  (a)  no 
alternative  could  be  ruled  out  even  if  «,,(!)  was  assessed 
and  included  with  the  information  contained  in  Table  2 
and  (b)  only  after  all  the  additional  information  listed  in 
Table  3  was  provided  could  alternative  3  be  considered 
the  most  preferred.  Here  the  results  in  (2j  are  less 
discriminating,  than  our  results,  and  will  never  be  more 
discriminating  since  ours  are  based  on  necessary  and 
sufficient  conditions  for  an  alternative  to  be  the  most 
preferred  for  all  possible  parameter  values,  while  in  [2J 
the  results  are  based  only  on  sufficient  conditions. 

In  order  to  more  fully  demonstrate  the  theor-.  've 
weakened  our  assumption  on  the  importance  weights  to 
»'j  S  »,  S  w4  5  h-j  m  w,  s  w,  which  is  consistent  with 
their  precise  values,  and  found  that  R  «{(3, 1),(3,4)} 
for  all  levels  of  additional  utility  value  information 
(including  'none')  listed  in  Table  3.  Then  we  additionally 
assumed  that  —  0.3,  R  «  {(3, 1),  (3, 4)}  for  all  levels  of 
information  in  Table  3  except  the  last  level.  The  addition 
of  i/;,(3)  *  O  S  produced  R  =  {(3, 1).  (3, 2).  (3, 4)}.  Thus, 
with  only  an  ordinal  ranking  of  the  importance  weights 
consistent  with  their  precise  values,  we  were  able  to 
eliminate  alternatives  1  and  4  without  any  utility  value 
information  other  than  that  contained  in  Table  2t  If  we 
also  assumed  that  w,  =  0.3,  then  our  approach  required 
the  same  amount  of  additional  utility  value  information 
that  the  approach  in  (2]  required  in  order  to  determine 
that  alternative  3  is  the  most  preferred. 


CONCLUSIONS 

We  have  presented  an  interactive  procedure  for  alice- 
native  selection  based  on  utility  theory  which 
parameter  value  information  to  be  imprecise.  This  -rvw 
eedure  produces  at  least  as  much  information  rcordme 
alternative  ranking  as  does  a  recently  proposed  alterna¬ 
tive  ranking  procedure  presented  in  (2).  An  curre 
presented  in  [2]  has  been  used  to  illustrate  this  tact 
Determining  effective  methods  for  assessing  parameter 
value  information  is  a  topic  for  future  research. 


REFERENCES 

1.  Keeney  RL  and  Raiffa  H  (1976)  Decisions  wim 
Multiple  Objectives.  John  Wiley,  New  York. 

2.  Sarin  RK  (1977)  Screening  of  multiattribute  alter¬ 
natives.  Omega  5(4),  481-489. 

3.  Sarin  RK  (1977)  Interactive  evaluation  and  bound 
procedure  for  selecting  multi-attributed  alternatives. 
In  TIMS  Stud,  irt  Mgmt  Sci.  6,  211-224. 

4.  White  CC,  Sage  AP  and  Dozoso  S  (1982)  An 
interactive  approach  to  alternative  ranking  in¬ 
volving  inverse  decision  aiding.  Proc.  6th  I  FAC 
Symposium  on  Identification  and  Parameter  Esti¬ 
mation  Washington,  DC. 

J.  White  CC.  Sage  AP  and  Sthtrer  WT  (I9S21 
Decision  support  with  partially  identified  parame¬ 
ters.  Large  Scale  Systems  3.  177-189. 

Chelsea  C  White  III 
Shigeru  Dozono 
William  T  Scherer 

(June  19$: ) 

Department  of  Engineering  Science  and  Systems 

Thornton  Hall 

University  of  Virginia 

Charlottesville 

VA  22901 

USA 


The  International  Journal  of  Management  Science 
Volume  11,  Number  2,  1983 


Contents 


Main  Papers 

Keith  Pavttt 

113 

Characteristics  of  Innovative  Activities 
in  British  Industry 

John  DW  Morecroft 

131 

System  Dynamics:  Portraying  Bounded 
Rationality 

Yaakov  Roll,  Yeshayahu  Cohen 

143 

Overall  Labour  Productivity  Indices  in 
a  Multi-product  Multi-stage  Environ¬ 
ment 

Hee  Won  Kang,  Sung  Joo  Park  147 

AJ  Rowe,  I A  Somers  155 

BG  Dale,  D  Russell  175 

George  P  Cosmetatos  187 


An  Efficient  Curve  in  Stochastic 
Capacity  Expansion 

Methods  to  Predict  Performance  in 
Major  Program  Acquisition 

Production  Control  Systems  for  Small 
Group  Production 

Increasing  Productivity  in  Exponential 
Queues  by  Server-sharing 


MP1  Green,  P  McCarthy,  155 

L  Pearl 

SC  Bhatnagar  201 

Memoranda 

James  H  Barnes  Jr  209 

Chelsea  C  White  III,  212 

Shigeru  Dozono, 

William  T  Scherer 


Multi-objective  Allocation:  A  Data- 
free  Approach 

Locating  Social  Service  Centres  Using 
In.eractive  Graphics 


The  Experience  Curve — Artifact  or 
Reality 

An  Interactive  Procedure  for  Aiding 
Multiattribute  Alternative  Selection 


International  Register  of  215 

Theses  and  Dissertations 

Erratum  221 

ISSN  030S-0483 
OMGABX  11(2)  113-222  (1983) 


Pergamon  Press 


fainted  in  Great  Britain  by  A.  Wheaton  &.  Co.  Ltd,  Exeter 


375 


35 


IEEE  TRANSACTIONS  ON  SYSTEMS.  MAN.  AND  CYBERNETICS.  VOL  SMC-14.  NO.  1.  JANUARY/EEBRUARY  1984 

ARIADNE:  A  Knowledge-Based  Interactive 
System  for  Planning  and  Decision  Support 

ANDREW  P.  SAGE,  fellow,  ieee,  and  CHELSEA  C.  WHITE.  III.  member,  ieee 


Afatract — The  development  of  an  interactive  planning  and  decision 
support  process  for  multiple  criteria  alternative  selection  situations  is 
discussed.  Probabilities,  utility  scores  for  the  lowest  level  attributes,  and 
attribute  node-off  weights,  i.e.,  the  parameters,  can  be  imprecisely  de¬ 
scribed  by  set  inclusion.  Within  a  specified  structural  model  of  the  decision 
situation,  the  process  allows  the  decisionmaker  to  iteratively  select  the  mix 
of  parameter  value  precision  and  alternative  ranking  specificity.  By  select¬ 
ing  this  mix.  the  decisionmaker  is  able  to  direct  the  alternative  selection 
process  in  an  interactive  manner,  using  alternative  selection  strategies 
based  on  behavioral!)'  meaningful  dominance  search  strategies.  Emphasis  is 
placed  on  the  motivation  of  the  research  and  the  behavioral  relevance  of 
the  support  process.  References  in  the  bibliography  provide  further  analyti¬ 
cal  and  behavioral  discussions  related  to  this  process. 

I.  Introduction  and  Motivation  for  the 
Research 

IT  HAS  BEEN  observed  that  the  process  of- choosing 
among  multiattributed  alternatives  often  involves  an  ini¬ 
tial  search  for  a  dominance  structure  and  ultimate  identifi¬ 
cation  of  a  set  of  nondominated  alternatives,  alternatives 
which  are  not  worse  than  any  other  alternative  on  any 
attribute  and  which  are  better  than  each  other  alternative 
on  at  least  one  attribute.  In  most  decision  situations, 
however,  no  single  alternative  dominates  all  other  alterna¬ 
tives,  at  least  initially.  In  such  decision  situations,  the 
decisionmaker  typically  "adjusts”  the  structure  of  the  deci¬ 
sion  situation  and  parameter  values  within  this  structure  so 
as  to  identify  a  dominance  structure  which  contains  a 
single  nondominant  alternative.  This  search  may  involve 
rational  activities,  such  as  aggregation  of  attributes  and 
compensatory  trade-offs  through  determination  of  judg¬ 
mental  weights.  Alternatively,  it  may  involve  various  rules 
which  may  be  quite  flawed.  Examples  of  such  rules  are  1) 
lexicographic  ordering,  in  which  the  best  alternative  on  the 
most  important  attribute  is  selected,  and  2)  sequential 
pairwise  comparison  of  alternatives  using  a  preference 
relation  that  is  a  function  of  the  two  alternatives  being 
compared.  In  this  latter  case,  nontransitive  preferences 
may  easily  result  due  to  the  fact  that  the  contextual  rela¬ 
tion  used  to  determine  preferences  changes  from  binary 
comparison  to  binary  comparison. 

A  variety  of  holistic,  heuristic,  and  wholistic  judgmental 
activities  will  typically  be  involved  in  the  search  for  a 
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dominance  structure  among  the  alternatives.  These  take  on 
various  forms  and  mixtures  of  formal  knowledge-based, 
rule-based,  or  skill-based  activities  as  deemed  appropriate 
for  the  task  at  hand  [1],  [2].  Especially  with  a  large  number 
of  alternative  courses  of  action  under  consideration,  the 
decision  process  will  typically  involve  mixed  scanning, 
where  some  noncompensatory  rule  is  first  used  to  eliminate 
grossly  inappropriate  alternatives.  This  is  then  followed  by 
one  or  more  compensatory  information  evaluation  opera¬ 
tions  that  results  in  a  dominance  structure  which  enables 
final  judgment  and  alternative  selection. 

The  research  discussed  here  is  based  upon  the  hypothesis 
that  people  are  able  to  evaluate  alternative  plans  and 
decisions  efficiently  and  effectively  and  with  low  stress 
when  a  clear  dominance  pattern  exists  among  alternatives 
that  allows  the  establishment  of  a  sufficiently  discrimina¬ 
tory  priority  structure.  Our  goal  is  to  provide  a 
knowledge-b  decision  support  process  that  enhances 
the  quality  of  thw  dominance  structure  used  for  judgment 
and  choice. 

Often  people  process  information  poorly  through  various 
forms  of  selective  perception.  A  typical  flaw  involves  ignor¬ 
ing  potentially  disconfirming  information  in  order  to  per¬ 
ceive  a  dominance  pattern  among  alternatives  when  no 
such  pattern  exists.  Another  flaw  is  to  evaluate  one  non¬ 
dominant  alternative  incrementally  higher  than  another 
one  after  the  introduction  of  alternatives  asymmetrically 
dominated  by  the  first  nondominant  alternative  but  not  by 
the  second.  Sequential  pairwise  comparison  of  alternatives 
often  assumes  an  implicit  contextual  relation  >  ,  where 
A  >  B  suggests  that  choosing  A  and  rejecting  B  is  prefer¬ 
able  to  choosing  B  and  rejecting  A  [3]. 

Thus  the  preference  relation  is  alternative  dependent  in 
general,  and  nontransitive  results  can  be  expected  from  its 
use  in  unaided  situations.  Agenda-dependent  results  will 
typically  occur  in  aided  situations  if  we  force  transitivity 
through  the  use  of  transitive  inference  and  associated  ne¬ 
glect  of  questions  that  would  have  provided  results  which 
would  have  disconfirmed  the  transitivity  assumption.  Thus 
there  seems  much  motivation  to  provide  assistance  in  this 
search  for  a  dominance  structure  that  will  assist  in  the 
process  of  judgment,  choice,  and  decision  [4],  [5]. 

In  this  paper,  we  provide  an  overview  of  our  research  to 
these  ends.  The  next  section  will  present  a  summary  of  the 
features  and  structural  constructs  of  our  decision  support 
system.  The  following  section  presents  a  more  detailed 
discussion  of  these  structural  constructs  and  introduces 
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some  of  the  modes  in  which  the  support  process  can  be 
used.  Then  we  discuss  some  behavioral  issues  that  relate  to 
the  conceptual  design  of  ARIADNE.  Next  we  present  a 
brief  description  of  some  of  the  algorithmic  constructs  that 
allow  and  assist  the  development  of  dominance  structures 
for  the  various  modes  in  which  use  of  the  support  system  is 
possible.  Some  very  simple  illustrative  examples  are  fol¬ 
lowed  by  a  section  devoted  to  conclusions  and  extensions 
to  our  research  that  are  currently  in  progress. 

II.  Features  of  the  Decision  Support  System 

We  now  investigate  concepts  for  the  design  and  eval¬ 
uation  of  an  interactive  knowledge-based  planning  and 
decision  support  system  which  combines,  or  allows  the 
combination  of,  several  evaluation  rules  and  contingency 
structures  often  used  as  a  basis  for  evaluation,  prioritiza¬ 
tion.  judgment,  and  choice.  We  have  developed  a  knowl¬ 
edge-based  system  to  interactively  aid  planning  and  deci¬ 
sion  support  processes  through  encouragement  of  the  search 
for  a  dominance  structure  that  is  behaviorally  realistic  and 
rational,  from  both  a  substantive  and  procedural  view¬ 
point.  The  support  system  is  called  Alternative  Ranking 
Interactive  Aid  based  on  DomiNance  structural  informa¬ 
tion  Elicitation  (ARIADNE).  The  support  system  allows 
the  use  of  various  integrated  forms  of  wholistic,  heuristic, 
and  holistic  reasoning  in  an  aided  search  for  dominance 
information  among  identified  alternatives.  We  believe  it  to 
be  flexible  enough  to  match  diverse  decision  situations  and 
environments  closely  in  order  to  support  varying  cognitive 
skills  and  decision  styles,  thereby  enabling  planners  and 
decisionmakers  to  adapt  its  use  to  their  own  cognitive 
skills,  decision  styles,  and  knowledge. 

Our  efforts  have  concerned  choice-making  situations  un¬ 
der  certainty  and  under  risk,  primarily  for  the  single  deci¬ 
sion  node  case.  This  formulation  allows  the  consideration 
of  a  variety  of  imprecisely  known  parameters  such  as 
attribute  trade-off  weights,  outcome  state  values  on  lowest 
level  attributes,  event  outcome  probabilities,  and  various 
combinations  of  these.  Parameter  needs  are  determined 
from  the  structure  of  the  decision  situation,  as  elicited  from 
the  decisionmaker  during  the  formulation  and  analysis 
steps  of  the  decision  support  process.  We  consider  these 
formulation  and  analysis  steps  to  be  outside  the  scope  of 
our  present  software  developments  but  recognize  the  essen¬ 
tial  need  for  them  in  a  complete  decision  support  process. 

The  decision  situation  structural  model  may  represent 
decisions  under  risk  or  under  certainty.  The  attribute  tree 
representing  the  features  of  decision  outcome  states  may  be 
structured  and/or  parameterized  in  a  top-down  or  bottom- 
up  fashion  through  use  of  ARIADNE.  A  single-level  struc¬ 
ture  or  a  multiple-level  hierarchical  structure  of  attributes 
may  be  used  with  the  choice  of  these  being  at  the  discretion 
of  the  decisionmaker.  Multiple  decision  node  situations 
may  be  approached  through  a  goal  directed  decision  struc¬ 
turing  approach  in  which  the  growth  of  the  structure  of 
alternative  decisions  and  event  outcomes  is  guided  by 
sensitivity-like  computations  obtained  through  use  of  the 
ARIADNE  algorithms  (6j-(8]. 


Parameters  are  elicited  from  the  decisionmaker  in  the 
form  of  equalities  and  inequality  bounds.  A  variety  ->f 
mathematical  programming  approaches  and  graph  the  y 
have  been  used  to  generate  interactive  displays  of  preter- 
ence  digraphs.  These  mathematical  programming  ap¬ 
proaches  are  used  to  determine  dominance  structures  r 
alternative  prioritization  that  are  based  on  parameter  inf 
mation  elicited  from  the  decisionmaker.  At  present,  only  a 
linear  programming  approach  will  yield  necessary  a'  .J 
sufficient  conditions  for  determination  of  a  priority  str  •- 
ture  and  computational  times  that  are  consistent  with 
interactive  decision  aiding  This  requires  that  we  elU»t 
structural  parameter  information  in  a  slightly  restric  i 
form  which  we  denote  the  “behaviorally  consistent  infor¬ 
mation  set”  (BCIS).  Often  this  BCIS  will  be  in  such  a  form 
that  solution  of  the  generally  nonlinear  programming  prc  - 
lems  associated  with  determination  of  dominance  stn™- 
tures  can  be  replaced  by  the  solution  of  simple  computa¬ 
tionally  amenable  linear  programs  with  bounded  variabL  . 
The  major  simplification  associated  with  eliciting  paran  - 
ter  imprecision  in  a  prespecified  structural  format,  how¬ 
ever,  is  in  the  natural  language  dialogue  needed  to  estabPh 
a  model  of  the  decision  situation. 

The  purpose  of  the  graph  theory  algorithm  is  to  allow 
the  construction  of  a  domination  digraph  or  dominance 
structural  model.  This  digraph  is  a  pictorial  representati  i 
of  the  ordinal  preferences  as  determined  from  a  dominance 
reachability  matrix.  This  matrix  is  determined  by  the  linear 
programming  algorithms  from  the  decision  situation  strur* 
ural  model  and  parameters  elicited  from  the  decisic  • 
maker.  These  domination  digraphs  encourage  either  selec¬ 
tion  of  a  preferred  alternative,  or  further  iteration  using  t’  ■' 
aggregated  preference  information  for  feedback  learning. 

An  inverse  aiding  feature  is  currently  being  incorporated 
into  the  decision  support  system.  This  feature  allows  the 
decisionmaker  to  make  wholistic  skill-based  prioritizatio' 
among  alternatives.  These  prioritizations  may  be  acrooo 
some  or  all  identified  alternatives,  at  the  top  level  of  the 
hierarchy  of  attributes  or  at  some  intermediate  level.  If  v 
elicit  numerical  bounds  on  the  attribute  scores  for  tho 
attributes  which  are  subordinate  to  and  included  within  the 
attribute  at  which  alternatives  are  prioritized,  then  bourn’ 
on  attribute  weights,  consistent  with  the  wholistic  priorif 
zation,  may  be  determined  by  using  a  linear  programming 
approach.  Alternately,  if  weights  are  specified,  then  it  .<« 
possible  to  determine  bounds  on  alternative  scores  on  tho:’- 
attributes  subordinate  to  the  attribute  at  which  priori tiza/ 
tion  was  made  through  the  use  of  linear  programming 
algorithms. 

As  alternatives  are  identified  and  prioritized,  updates  c 
these  bounds  are  made  available.  The  results  obtained  from 
using  the  inverse  aiding  feature  are,  in  may  ways,  compart 
ble  to  those  obtained  from  the  regression  analysis  base 
social  judgment  theory  [9].  This  approach  provides  weight 
identification  only,  with  a  “confidence”  measurement  cor.- 
cerning  the  validity  of  weights;  cardinal  preferences  ai  - 
assumed.  Results  in  the  form  of  bounds  on,  or  ranges  oi,‘ 
weights  are  available  with  a  very  few  alternative  prioritiza- 
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lions  in  the  inverse  aiding  approach.  The  prioritizations 
needed  may  involve  a  mixture  of  cardinal  and  ordinal 
preferences.  For  a  large  number  of  prioritizations,  the 
inverse  aiding  approach  may  become  cumbersome  compu¬ 
tationally  compared  to  the  regression-based  approach, 
where  additional  information  may  be  easily  processed  in  a 
sequential  fashion. 

The  combination  of  inverse  and  direct  aiding  to  enhance 
decisionmaker  specification  of  imprecise  values,  weights, 
and  probabilities  enhances  the  usefulness  of  ARIADNE 
since  it  allows  for  judgments  and  their  explanation,  using  a 
combination  of  formal  knowledge-based  and  skill-based 
modes.  This  enhanced  usefulness  will  also  occur  through 
encouragement  to  the  decisionmaker  to  become  more  aware 
of  relevant  alternative  courses  of  action  and  to  identify 
new  alternatives  on  the  basis  of  feedback  learning  of  the 
impacts  of  alternatives  upon  issues  and  objectives  in  a 
behaviorally  relevant  way  that,  hopefully,  encourages 
“double-loop  learning”  [10]. 


III.  Structure  of  ARIADNE 

A  complete  set  of  activities  envisioned  in  using  the 
single-stage,  or  single  decision  node,  version  of  ARIADNE 
involves  the  following  set  of  activities. 

A.  Formulation  of  the  Decision  Situation 

1)  Define  the  problem  or  issue  that  requires  planning 
and  decisionmaking  by  identification  of  its  elements  in 
terms  of  a)  needs,  and  b)  constraints  or  bounds  on  the 
issue. 

2)  Identify  a  value  system  with  which  to  evaluate  alter¬ 
native  courses  of  action,  and  identify  objectives  or  attri¬ 
butes  of  the  outcomes  of  possible  decisions  or  alternative 
courses  of  action. 

3)  Identify  possible  alternative  courses  of  action  or  op¬ 
tion  generation. 


B.  Analysis  of  the  Decision  Situation 

1)  Determine  outcome  scenarios. 

2)  Identify  decision  structural  model  elements,  that  is, 
those  elements  or  factors  from  the  conceptual  formulation 
framework  which  appear  pertinent  for  incorporation  into  a 
decision  situation  structural  model. 

i  3)  Structure  decision  model  elements: 

a)  structure  decision  tree, 

b)  structure  information  acquisition  and  processing 
tree— which  may  be  part  of  the  basic  decision  tree, 
and 

*  c)  structure  attribute  tree  or  objectives  hierarchy. 

4)  Determine  independence  conditions  among  elements 
of  the  attribute  tree  and  decision  alternatives, 
v.  5)  Identify  potential  for  the  use  of  deficient  information 
•'  processing  heuristics,  and  provide  appropriate  debiasing 
procedures. 
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6)  Determine  impacts  of,  or  outcomes  that  may  result 
from,  alternative  courses  of  action. 

7)  Encode  uncertainty  elements  in  the  form  of  event 
outcome  probabilities,  or  bounds  on  these,  to  the  extent 
possible. 

8)  Identify  risk  aversion  coefficients,  if  needed,  to  the 
extent  possible. 

9)  Identify  preference  or  value  functions,  or  bounds  on 
these  functions,  to  the  extent  possible. 

10)  Identify  attribute  weights,  or  bounds  on  these  func¬ 
tions,  to  the  extent  possible. 

11)  Identify  wholistic  preferences  among  alternatives  to 
the  extent  that  this  is  possible. 

12)  Identify  possible  disjunctive  and  conjuctive  aspects, 
or  thresholds  for  attributes,  of  identified  alternative  courses 
of  action. 


C.  Evaluation  and  Interpretation  of  the  Outcome  of 
Alternative  Courses  of  Action 

1)  Identify  a  decision  aiding  protocol  or  plan  for  evalua¬ 
tion  and  interpretation  of  the  decision  situation. 

2)  Identify  potential  for  use  of  deficient  judgment  heur¬ 
istics. 

3)  Use  conjunctive  and/or  disjunctive  scanning  to 
eliminate  very  deficient  alternatives  and  retain  alternatives 
meeting  minimum  acceptability  criteria  across  attributes. 

4)  Determine  the  maximum  amount  of  domination  in¬ 
formation  possible. 

a)  Display  domination  digraph. 

b)  Identify  alternative  courses  of  action  which  could 
not  be  among  the  S  most  preferred  alternatives.  Normally, 
these  are  deleted  from  further  consideration. 

c)  If  the  decisionmaker  can  select  an  alternative  for 
implementation  by  wholistic  judgment,  or  prioritize  the 
remaining  alternative  set  through  heuristic  elimination,  then 
go  to  step  6)  of  evaluation  and  interpretation  (Section 
III-C). 

d)  If  a  choice  cannot  be  made,  then  assess  further 
information  about  values  of  imprecisely  known  parameters 
by  iterating  through  steps  6)— 11)  of  analysis  (Section  III-B), 
then  return  to  step  1)  of  the  evaluation  and  interpretation 
(Section  III-C).  Many  possibilities  exist  for  obtaining 
greater  alternative  evaluation  specificity  such  as 

i)  setting  higher  aspiration  levels  or  aspects, 

ii)  moving  up  the  attribute  tree  by  determination  of 
a  subset  of  attribute  tradeoff  weights, 

iii)  “tightening”  bounds  on  attribute  trade-off 
weights, 

iv)  tightening  bounds  on  event  outcome  probabili¬ 
ties,  possibly  through  information  processing  up¬ 
dates, 

v)  tightening  bounds  on  values  or  preference  func¬ 
tions. 

5)  If  the  decisionmaker  has  provided  (partial)  wholistic 
preferences  as  part  of  the  analysis  effort,  use  these  with  the 
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inverse  aiding  feature  of  the  aid  to  determine  bounds  on 
attribute  weights  implied  by  these  preferences  such  as  to 
provide  learning  feedback  to  decisionmaker. 

6)  Conduct  sensitivity  analysis.  Provide  the  decision¬ 
maker  with  an  indication  of  how  sensitive  the  optimal 
action  alternative,  or  prioritization  of  alternatives,  is  with 
respect  to  changes  in  values  and  information  about  im¬ 
pacts. 

7)  Evaluate  validity  and  veracity  of  the  approach.  En¬ 
courage  judgment  concerning  whether  the  formulation, 
analysis,  and  interpretation  are  sound.  If  not,  encourage 
appropriate  modification  to  structure  and  parameters  asso¬ 
ciated  with  the  decision  situation,  including  identification 
of  additional  attributes  and  alternative  courses  of  action. 
Then,  iterate  back  to  an  appropriate  step  and  continue. 

In  our  work  to  date,  we  assume  that  the  details  of  issue 
formulation  and  analysis  are  accomplished  external  to  the 
interactive  aid  itself.  A  variety  of  procedures  exists  for 
accomplishing  these  tasks  [11].  Our  research  assumes  that, 
an  issue  formulation  structure  exists  and  that  the  impacts 
of  alternatives  are  known.  These  are  provided  through 
various  elicitation  activities.  We  do  not  envision  that  the 
software  we  develop  for  interactive  interpretation,  including 
evaluation  and  prioritization,  will  generally  be  suitable  for 
use  independent  of  a  trained  decision  analyst.  Whether 
software  can  be  evolved  to  result  in  an  appropriate  “stand 
alone”  aid  is  very  dependent  upon  the  environment  and 
other  factors  that  constitute  the  contingency  task  structure 
for  a  specific  situation.  In  situations  which  are  repetitive 
and  environments  which  are  stable,  such  as  in  health  care 
or  equipment  fault  diagnosis  situations,  it  seems  entirely 
possible  to  design  useful  “stand  alone”  aids.  In  most 
strategic,  and  in  many  tactical  situations  there  will  not  be  a 
stable  underlying  structure  that  will  easily  allow  this.  The 
activities  involved  in  issue  framing  and  the  identification  of 
a  dominance  structure  appropriate  for  decisionmaking  are 
often  very  situation  dependent. 

A  number  of  considerations  influence  planning  and  deci¬ 
sion  support  processes.  The  person  using  a  decision  sup¬ 
port  system  should  be  aware  of  these  considerations  if  best 
use  of  the  aiding  process  is  to  be  obtained.  Generally,  these 
considerations  involve  the  operational  environment  and  the 
familiarity  of  the  decisionmaker  with  the  environment  and 
task  at  hand.  It  is  the  interaction  of  these  factors  that 
influence: 

1)  behavioral  characteristics  of  the  decisionmaker, 

2)  interaction  between  decisionmaker  and  analyst, 

3)  choice  of  computer-based  support  for  decisionmaker 
analyst  interaction 

Among  the  behavioral  characteristics  of  the  decision¬ 
maker  that  influence  aiding  consideration  strongly  are  the 
facts  that  the  decisionmaker 

1)  is  often  impatient  with  time  consuming  and  stressful 
assessment  procedures; 


2)  wants  to  see  some  preliminary  results  promptly  if 
these  are  needed  or  wanted; 

3)  may  lack  interest  in  interacting  directly  with  comf.  :x 
quantitative  procedures  for  decision  aiding  that  do 
not  seem  tailored  to  the  specific  contingency  r~.k 
structure  of  the  issue  at  hand;  and,  as  a  consequei  e, 

4)  requires  a  decision  aiding  approach  that  adapts  to  the 
decisionmaking  style  appropriate  for  the  decision¬ 
maker  in  the  given  contingency  task  structure. 

A  number  of  considerations  influence  the  most  desirable 
interaction  between  the  decisionmaker  and  the  analyst.  The 
interaction  must  be  such  that  these  result: 

•  a  list  of  objectives  and  an  objectives  hierarchy, 

•  a  list  of  alternatives,  and 

•  a  list  of  outcomes  for  each  alternative.  ^ 

The  extent  of  the  need  for  the  use  of  these  identified  lists 
will  vary  greatly  with  the  “expertise”  of  the  decisionmal  r. 
A  major  task  of  the  analyst  in  the  formulation  and  anal:  >s 
portion  of  the  aiding  effort  is  to  assist  the  decisionmaker  in 
obtaining  these  lists  in  a  behaviorally  relevant  and  realr'ic 
manner.  The  analyst  must  also  ensure,  to  the  extent  po““i- 
ble,  that 

1)  the  foregoing  lists  are  reasonably  complete; 

2)  the  lowest  level  objectives  are  additively  independe  .; 

3)  the  alternatives  are  mutually  exclusive;  and 

4)  the  outcomes  that  follow  from  each  alternative  £=e 

mutually  exclusive  and  exhaustive.  — 

The  nature  of  the  interactive  process  is  such  that  iterative 
changes  can  be  made  in  terms  of  addition  or  deletion-;.! 
alternatives  and  attributes.  Nevertheless,  there  are  sign! '  - 
cant  advantages  in  attempting  to  be  reasonably  complete  at 
the  start  of  the  interpretation  portion  of  the  process.  _ 

The  decisionmaker  must  provide  the  analyst,  follow  g 
behaviorally  realistic  elicitation  procedures,  with  informa¬ 
tion  regarding  1)  alternative  scores  on  lowest  level  attri¬ 
butes,  2)  trade-off  weights,  3)  probabilities,  and  4)  relaf  e 
risk  aversion  coefficients,  or  else  appropriate  ratios  or 
bounds  on  these  quantities  which  represent  the  precision 
that  the  decisionmaker  believes  appropriate  or  is  capa'/e 
of  providing  for  the  given  decision  situation. 

Many  computer-based  support  perspectives  evolve  from 
decisionmaker-analyst  interaction  considerations.  A  gr  1 
of  all  decision  support  system  design  efforts  is  to  obtijj 
“friendly”  software,  software  that  is  friendly  both  to  the 
decisionmaker  and  the  analyst.  In  particular,  the  anab'JLt 
must  be  able  to  interpret  the  decisionmaker’s  struct u-  -l 
and  parameter  information  for  input  to  the  computer,  I  6 
do  this  may  require  1)  redefining  the  outcome  space,  such 
as  redefinition  of  attributes  to  ensure  satisfaction  of  inc 
pendence  considerations,  and  2)  describing  parameter  ir. 
formation  in  terms  of  inequalities  (or  more  generally  set 
membership). 

The  analyst  must  be  able  to  interpret  computer  output  _  t 
a  fashion  that  facilitates  the  decisionmaker’s  understanding 
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and  decisionmaking  abilities.  The  analyst  must  be  able  to 
assist  the  decisionmaker  in  responding  to  the  following 
question  that  is  central  in  our  interactive  knowledge-based 
support  system:  Has  sufficient  preference  and  structural 
information  been  elicited  from  and  provided  to  the  decision¬ 
maker  for  alternative  selection,  or  is  more  information  re¬ 
quired  for  identification  of  a  dominance  structure  that  is 
relevant  and  appropriate  for  quality  decision  support  ?  Change 
receptivity  must  therefore  be  an  inherent  part  of  this  user 
friendliness. 

If  the  decisionmaker  feels  that  an  alternative  can  be 
selected  for  action  implementation  at  any  stage  in  the 
interactive  aiding  effort,  the  analyst  must  be  able  to  en¬ 
courage  decisionmaker  judgment  concerning  whether  or 
not  the  issue  formulation,  analysis,  and  interpretation  are 
sound.  If  the  issue  formulation,  analysis,  and/or  interpre¬ 
tation  are  not  perceived  as  sound  by  the  decisionmaker,  the 
analyst  must  be  able  to  encourage  appropriate  structural 
and  parameter  value  modification,  typically  by  means  of 
sensitivity  analysis,  in  order  to  insure  effective,  explicable, 
and  valid  planning  and  decision  support.  If  the  decision¬ 
maker  cannot  choose  an  alternative  from  among  those 
considered,  the  analyst  must  be  capable  of  eliciting  further 
structural  and/or  parameter  information  to  enhance  ap¬ 
propriate  selection  of  alternative  courses  of  action. 

One  very  important  feature  of  a  knowledge-based  system 
for  planning  and  decision  support  is  encouragement  to  the 
decisionmaker  for  generating  new  options,  outcomes,  and 
attributes  at  essentially  any  point  in  the  aiding  effort  and 
ability  to  evaluate  these  new  options  properly.  The  analyst 
must  be  able  to  cope  with  this  additional  information 
under  the  assumption  that 

1)  the  new  information  is  consistent  with  previously 
obtained  information,  or 

2)  the  new  information  is  not  consistent  with  previously 
obtained  information  due  to  a)  structural  inconsistencies  or 
b)  parameter  inconsistencies. 

Thus  the  capacity  to  resolve  potential  inconsistencies 
through  interaction  with  the  decisionmaker  must  exist 
within  the  planning  and  decision  support  process.  The 
indirect  or  inverse  decision  aiding  feature  should  be  of 
particular  value  to  this  end.  In  a  “policy  capture”  like 
fashion,  this  indirect  feature  will  allow  identification  of 
bounds  on  attribute  weights  in  terms  of  wholistic  prefer¬ 
ences  among  some,  or  all,  alternatives.  In  the  direct  aiding 
feature,  values,  weights,  and  probabilities  are  identified 
and  prioritization  of  alternatives  result  from  this.  Com¬ 
bined  use  of  the  direct  aiding  feature  with  indirect  aiding 
should  result  in  much  learning  feedback  concerning  rela¬ 
tions  among  the  various  modes  of  judgment. 

ARIADNE,  as  we  have  noted,  does  not  contain  software 
to  assist  in  the  formulation  and  analysis  portion  of  the 
planning  and  decision  support  effort.  It  is  in  these  two 
steps  that  alternative  choices,  attributes,  and  decision  im¬ 
pacts  or  outcomes  are  elicited  or  identified.  Our  effort  is 
much  more  concerned  with  the  interpretation  part  of  a 
decisionmaking  effort,  that  is  to  say,  how  information 


is  processed  concerning  formulation  and  analysis-based 
quantities  such  as  probabilities,  values,  weights,  ratios,  and 
bounds  upon  these.  We  are  concerned  also  with  the  way  in 
which  this  information  is  aggregated,  by  any  of  a  variety  of 
formal  knowledge-,  rule-,  or  skill-based  modes  of  cognition 
that  result  in  judgment  and  choice.  We  recognize  the 
difficulties  in  separating  the  tasks  of  formulation  and  anal¬ 
ysis  from  those  of  interpretation.  Difficulties  exist  at  the 
systems  management  level  since  the  way  in  which  people 
cognize  a  problem,  as  part  of  the  contingency  task  struc¬ 
ture  of  a  particular  situation,  determines  the  way  in  which 
they  will  go  about  resolving  it.  Thus  the  performance 
objectives,  information  processing  style,  and  decision  style 
that  are  most  appropriate  and  likely  to  be  used  for  a  given 
task  are  very  much  dependent  upon  the  task  itself.  When  a 
particular  concrete  operational  or  skill-based  strategy  has 
yielded  previous  satisfactory  results,  many  people  will  tend 
to  use  that  strategy  unquestioningly  and  uncritically  in  new 
situations  perceived  to  be  similar.  This  can  result  in  very 
unsatisfactory  judgments  and  choices  in  decision  situations 
that  have  changed  and  that  are  not  recognized  as  different 
from  familiar  past  situations.  This  may  result  in  premature 
cessation  of  search  and  evaluation  of  alternatives  prior  to 
identification  of  quality  strategies,  even  for  familiar  situa¬ 
tions.  The  efforts  can  be  devastating  in  unfamiliar  environ¬ 
ments  that  are  not  so  recognized  [12]. 

The  strategies  which  a  decisionmaker  will  desire  to  use 
for  interactive  interpretation  will  be  strongly  dependent 
upon  the  way  in  which  the  task  requirements  are  initially 
cognized.  This  will  influence  the  objectives,  attributes,  and 
alternatives  generated  in  the  formulation  step  and  the  value 
scores  or  impacts  associated  with  them  in  the  analysis  step. 
The  input  information  to  the  interpretation  step  is  just  this 
information.  Adequacy  of  the  interactive  interpretation 
step  will  clearly  by  dependent  upon  the  “quality”  of  the 
information  input  to  it. 

Many  recent  studies  [13]  have  indicated  that  people 
often  construct  selectively  perceived  simple  deterministic 
representations  of  decision  situations  that  make  informa¬ 
tion  processing  easy  and  which  do  not  reflect  the  complexi¬ 
ties  and  uncertainties  that  are  associated  with  the  actual 
situation.  A  goal  of  a  decision  support  system  is  to  encour¬ 
age  wide  scope  perceptions  and  associated  information 
processing.  The  process  used  to  assess  probabilities,  utili¬ 
ties,  and  weights  will  doubtlessly  affect  the  quantities  that 
are  elicited.  It  is  possible,  for  example,  that  a  poor  elici¬ 
tation  procedure  may,  unknowingly  or  knowingly,  create 
rather  than  measure  values  [14],  An  advantage  to  formal 
support  for  planning  and  decisionmaking  processes  is  that 
it  is  possible  to  conduct  a  search  for  inconsistent  judgment 
and  perhaps  even  detect  flawed  information  processing 
heuristics  if  process  tracing  is  used.  When  inconsistencies 
are  discovered,  it  then  becomes  possible,  at  least  in  princi¬ 
ple,  to  examine  the  judgment  process  to  determine  which 
judgments  imply  flawed  information  processing,  and/or 
incoherent  or  labile  values,  and/or  deficient  decision  rules. 
A  major  ultimate  goal,  outside  the  scope  of  our  present 
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study,  is  to  suggest  debiasing  and  other  corrective  proce¬ 
dures  to  enhance  the  quality  of  human  information 
processing  and  decision  rule  selection. 

This  mixed  scanning  based  planning  and  decision  sup¬ 
port  system  is  based  upon  rational  search  for  a  dominance 
structure  which  will  enable  exposure  of  some  of  the 
processes  upon  which  judgment  and  choice  is  based.  In 
particular,  it  enables  determination  of  the  precise  point  in 
a  dominance  structure  search  process  when  a  decision¬ 
maker  is  able  to  select  a  single  nondominated  alternative. 
Thus  we  should  be  able,  for  example,  to  detect  violation  of 
the  regularity  and  similarity  hypotheses  that  often  occur 
when  a  number  of  asymmetrically  dominated  alternatives 
exists  [15].  More  importantly,  we  should  be  able  to  correct 
for  this  without  resorting  to  a  complete  elicitation  of 
precise  parameter  information  and  prioritization  of  all 
alternatives.  This  activity  is  often  stressful  and  time  con¬ 
suming.  may  require  perspectives  outside  the  experiential 
familiarity  of  the  decisionmaker,  and  allows  few  results 
until  conclusion  of  the  aiding  effort. 

The  overall  process  described  here  appears  well  suited  to 
accommodating  the  fact  that  neither  individuals  nor  groups 
possess  sutic  decision  styles  capable  of  being  stereotyped 
and  captured  by  an  inflexible  support  process.  It  is  specifi¬ 
cally  recognized  that  an  interactive  process  is  needed  that 
is  capable  of  adaptation  to  a  variety  of  decision  styles  that 
are  contingency  task  structure  dependent.  System  design 
should  reflect  the  realization  that  it  is  generally  not  possi¬ 
ble  to  define  a  problem  or  issue  fully  until  one  knows 
potential  solutions  to  the  issue.  A  major  cause  of  this  is  the 
fact  that  information  to  define  the  issue  fully  generally 
becomes  available  only  as  one  evaluates  potential  solu¬ 
tions.  Planning  and  decisionmaking  will  therefore  neces¬ 
sarily  be  iterative. 

IV.  Behavioral  Relevance 

Our  decision  support  system  design  paradigm  is  based 
upon  a  process  model  of  decisionmaking  in  which  a  person 
perceives  an  issue  which  may  require  a  change  in  the 
existing  course  of  action.  On  the  basis  of  a  framing  of  the 
decision  situation,  one  or  more  alternative  courses  of  ac¬ 
tion.  in  addition  to  the  present  option  which  may  be 
continued,  are  identified.  A  preliminary  screening  of  the 
alternatives,  using  conjunctive  and  disjunctive  scanning, 
may  eliminate  all  but  one  alternative  course  of  action. 
Unconflicted  adherence  to  the  present  course  of  action  or 
unconflicted  change  to  a  new  option  may  well  be  the 
metastrategy  for  judgment  and  choice  that  is  adopted  if  the 
decisionmaker  perceives  that  the  decision  situation  is  a 
familiar  one  and  that  the  stakes  are  not  so  high  that  a  more 
thorough  search  and  deliberation  is  needed  (12). 

Alternately,  if  the  decision  environment  is  an  unfamiliar 
one  or  the  stakes  associated  with  judgment  and  choice  are 
high,  more  vigilant  forms  of  informative  acquisition,  analy¬ 
sis,  and  interpretation  are  called  for.  This  desire  for  more 
vigilant  information  processing  leads  to  a  search  for  a 


dominance  pattern  among  alternatives,  the  search  for  new 
alternatives  that  are  not  dominated  by  presently  idem:'  ed 
alternatives,  and  the  elimination  from  further  considers  an 
of  dominated  alternatives.  If  no  single  nondominated  alter¬ 
native  is  found,  adjustments  to  the  dominance  structure  of 
alternatives  are  made  through  various  forms  of  cogn  ve  * 
activity  such  as  attribute  aggregation,  additional  infonna- 
tion  acquisition  and  analysis,  and  identification  of  addi¬ 
tional  attributes  and/or  alternatives.  This  is  contir  ed 
until  the  structure  of  needs,  objectives,  attributes,  id 
alternative  action  options  and  their  impacts  is  such  that 
identification  of  a  single  nondominated  alternative  res~Hs.  * 
This  single  alternative  may  well  represent  a  combinatio  of 
subaltematives.  If  the  time  and  experience  to  accomplish 
these  cognitive  activities  is  insufficient,  hypervigilance  °en- 
erallv  results.  The  decisionmaker  is  then  in  a  situe  on 
where  the  present  course  of  action  is  diagnosed  as  urrror- 
tunate.  and  there  is  not  enough  time  and  experience  toB 
allow  identification  and  evaluation  of  an  appropriate  a  :r- 
native  course. 

Given  sufficient  time  and  experience,  vigilant  informa¬ 
tion  processing  often  results  from  the  aforementioned  t;  <s. 
Fig.  1  presents  some  salient  features  of  this  domin  xt  ^ 
process  model  for  search,  discovery,  judgment,  and  choice. 

The  proper  mode  of  judgment  and  choice  depends  i,r'on 
the  decisionmaker's  situation  diagnosis  of  the  coming-  c> 
task  structure.  Here,  “proper”  decision  behavior  is  based  . 
upon  the  assumption  that  the  environment,  the  task,  the 
expenential  familiarity  with  the  task,  and  the  environr“nt  j 
that  constitutes  the  contingency  task  structure  are^  di¬ 
agnosed  coirectly.  If  this  is  not  the  case,  then  the  strategic? 
leading  to  unconflicted  change,  adherence,  or  vigilan  n- 
formation  processing  may  be  significantly  flawed.  The  >le 
of  the  contingency  task  structure  in  situation  diagnosis  and 
in  influencing,  at  a  meta  or  systems  management  level  'he  | 
process  of  judgment  and  choice  is  seen  to  be  a  :ry 
important  one.  It  leads  to  a  four-element  representation  ol 
situation  diagnosis  as  shown  in  Table  I  which  also  present? 
a  typology  of  the  decisionmaker  whose  behavior  ma’  re¬ 
flect  in  judgment  activities  in  either  of  the  four  quadi_.it? 
of  this  figure.  In  the  upper  right  quadrant,  where  true  g 
mastery  or  grand  mastery  of  a  decision  situation  resul  .  it 
is  doubtful  that  any  decision  support  system  will  b  ;or. 
much  direct  and  personal  use  to  the  decisionmaker.  Never- 
theless  it  may  have  much  indirect  use  in  enabling  acc  -isi 
tion  of  a  knowledge  base  and  as  a  useful  pedagogic?  oi 
learning  system  for  others.  I 

Many  realistic  paradigms  have  been  made  of  the  proces; 
of  judgment  and  choice.  We  believe  that  the  domin  net 
process  model  described  here  is  not  inconsistent  with  .hi 
primary  features  and  intensions  of  these  descriptive  models 
Our  purpose,  however,  is  to  develop  a  concej  rnal  dt  gr 
for  a  prescriptive  approach  to  judgment  and  choice  that.,  ’il  > 
aid  in  the  search  for  better  decisions.  We  recognize  that ;  . 
truly  rational  approach  to  prescriptive  decisionmaking  ^us  . 
be  cognizant  of  the  process  of  decisionmaking  as  it  evr'.-Ve:  ■" 
in  a  descriptive  fashion,  that  is  to  say,  process  rationafity 
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TABLE  1 

Taxonomy  of  Reactions  to  Decision  Situation  in  Terms  of 
Perceived  versus  Actual  Knowledge 


Perceived  Knowledge  Level 

NOVICE 

MASTER 

Decisionmaker  is  unaware 

Wholistic  intuitive  judgment 

> 

* 

that  considerable  judgment 

will  likely  lead  to  high 

.3 

uS 

ability  exists 

quality  decision  through 

i 

unconflicted  change  or 

TS 

W 

unconflicted  adherence 

> 

o 

Decisionmaker  is  aware 

Decisionmaker  may  be  a 

of  need  for  decision 

master  of  the  art  of 

_ 

O 

support  to  enable  holis- 

self  deception 

a 

•4 

u 

< 

tic  judgment 

or  it  will  not  be  possible  to  evolve  substantively  rational 
support  systems. 

It  is  important  that  an  appropriate  decision  support 
system  be  capable  of  assisting  the  decisionmaker  through 
encouragement  of  full  information  acquisition,  including 
that  which  may  disconfirm  strongly  held  beliefs,  and  in  the 
analysis  and  interpretation  of  this  information  such  as  to 
avoid  a  variety  of  cognitive  biases  and  poor  information 
processing  heuristics  that  may  lead  to  flawed  judgment  and 
choice  [2],  [13], 

A  realistic  decision  support  process  is  necessarily  itera¬ 
tive.  Several  desiderata  follow  from  this. 

1)  We  should  allow  for  top-down  or  bottom-up  structur¬ 
ing  of  the  attributes  of  outcomes,  or  impacts  of  decisions. 
The  “true”  or  “hierarchy”  of  attributes  should  be  struc¬ 
tured  to  the  depth  believed  appropriate  by  the  decision¬ 
maker. 

2)  Rather  than  force  a  decision  situation  structural  model 
in  the  form  of  a  tree,  we  should  encourage  the  decision¬ 
maker  to  identify  a  cognitive  map  of  goals,  objectives, 
needs,  attributes,  alternatives,  and  impacts  that  reflects  the 
way  in  which  he  perceives  diagnostic  and  causal  inferences 
to  occur.  At  some  later  time  this  cognitive  map  may  be 
used  to  structure  a  multinode  decision  tree  which  repre¬ 
sents  substantive  rationality,  but  not  necessarily  process 
rationality. 

3)  We  should  encourage  identification  of  alternative 
courses  of  action,  additional  attributes  of  decision  out¬ 
comes,  and  revisions  to  previously  obtained  elicitations,  at 
any  point  in  the  decision  support  process  as  awareness  of 
the  decision  situation  and  its  structure  grows  through  use 
of  the  support  system. 

4)  We  should  not  force  a  person  to  quantify  parameters 
to  the  extent  that  this  becomes  overly  stressful  or  behavior- 
ally  and  physically  irrelevant  in  view  of  the  inherent  uncer¬ 
tainty  or  imprecision  associated  with  the  knowledge  of 
parameters  characterizing  the  decision  situation  structural 
model  or  their  assessment. 

These  have  two  primary  implications  with  respect  to  our 
interpretation  efforts.  We  allow  for  revision  in  the  elicited 
structure  of  the  decision  situation  and  for  the  identification 
of  new  options  as  awareness  of  the  decision  situation 
grows.  Also,  we  do  not  require  the  decisionmaker  to  quan¬ 


tify  parameters  beyond  the  level  felt  appropriate  for  th 
situation  at  hand.  If  the  decisionmaker  feels  comfortai  ;  i: 
exercising  precision  with  respect  to  factual  outcomes  ’.hi 
is  perfectly  acceptable  and  desirable,  but  parameter  imprc 
cision  should  be  allowed  if  we  are  to  have  a  rerSti 
support  process. 

ARIADNE  allows  parameter  imprecision  in  order  t. 
satisfy  this  quantification  relevancy  requirement,  a*.d< 
approaches  based  on  fuzzy  set  theory  [16].  We  encoi  ;ag 
the  decisionmaker  to  specify  precise  values  or  numuica 
ranges  for  facts  and  values.  Thus  we  allow,  for  example 
expressions  for  alternative  (a)  scores  on  attributes  (“  ii 
the  form  0.2  <  v,(a)  <  0.5,  weights  associated  with  tri 
bute  (/')  in  the  form  0.2  <  w,  <  0.4,  and  probabilities  o 
event  (/')  resulting  from  alternative  (a)  in  the  form  C  “  ? 
P,(A)  <  0.45.  We  allow  ordinal  representations  in  th  lin 
ear  forms  v,(a)  <  v,(b)  <  v,(c),  2w,  <  wJ  <  wk,  Pj(a)  ? 
P,(a)  «S  3 Pk(a),  or  in  similar  forms.  Quantification  of  im 
precision  in  the  form  of  numerical  bounds  on  paranr  er 
always  leads  to  behaviorally  consistent  information  set 
(BCIS).  Sometimes  totally  ordinal  information  may  nee< 
further  quantification  in  order  to  make  the  precision^  jrn 
rigidity  of  the  mathematics  correspond  to  the  intensio  -  o 
the  decisionmaker  in  making  a  purely  ordinal  specification 
This  is  generally  not  needed  to  obtain  solutions  but  r  he 
to  obtain  parametric  models  that  are  faithful  to  the  u  ler 
standings  of  the  decisionmaker.  For  example,  that  ordina 
alternative  score  inequalities  0  $  t>,(a)  <  v,(b)  ^  u,(cV^ 
are  satisfied  by  the  relations  0  $  u,{a)  s£  1  -  2 t,w^  {b 

1  -  t,  2W  sj  v,(c)  1  for  small  positive  t  and  W  viukl 

in  the  limit  become  zero.  It  will  generally  not  be  the  cas 
that  the  decisionmaker  would  express  this  much  imp  rci  ' 
sion  and  would  wish  to  see  it  more  fully  quantific  t< 
reflect  (subjective)  beliefs.  It  is,  therefore,  important  that ; . 
simple  and  informative  display  of  value  scores,  weLhts , 
and  probabilities  be  provided  to  the  decisionmaker,  hi  ! 
will  enhance  interactive  use  of  the  support  system  and  wil 
enable  learning  of  the  impact  of  these  parameters,  Ant 
associated  imprecision,  upon  decisions. 


V.  Algorithmic  Content 

This  section  will  discuss  some  of  the  algorithmic  cot.-.'in 
supporting  the  decision  support  system.  To  facilitate  read 
ing,  we  will  make  each  subsection  of  this  description  (-art 
or  less  independent  of  other  subsections. 


A.  The  Attribute  Tree  and  Decisions  Under  Certainty 

It  is  possible  to  use  either  a  hierarchical  tree  structure  o 
a  single-level  structure  of  attributes,  each  of  which  ar 
shown  in  Fig.  2.  Fortunately,  the  relations  between  h< 
weights  associated  with  the  tree  structure  and  the  sitrjle 
level  structure  are  easily  determined.  They  are  given  in  Fig 
3(c).  Linear  inequalities  in  terms  of  hierarchical  weigh.-;  o 
weight  ratios  w>  become  linear  inequalities  in  tem;!-  o 
single-level  weights  p,.  It  is  this  fact  that  allows  us  to  ust 
the  single-level  representation  in  the  ARIADNE  soft”’ar 
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vl(*t)  v«(*i)  VjfXj)  v4(*t)  V5(x.)  v,(x.) 


(a) 


V(x.) 

W? 

V? 

_iL 

*sf~ 

yj 

"T5L 

-1 

V,^) 

V3(*i) 

3. 

vs(x4) 

VstXj) 

(b) 


pj  =  product  of  weights  in  path  froa  vj  to  v(k.) 

sua  of  p.  weights  over  those  i 
which  are  subordinate  to  attribute  a? 

yJ  ~  ,  — -  -  —  in  i  H 

k  sua  of  p.  weights  over  those  i  which  are  subordinate 
to  the  attribute  to  which  attribute  a£  is  subordinate 

Examples  P2  =  wj  v? 

w2  =  - Ba - 

2  Pi+te+Pa 

wj  =  p,  ♦  ps  ♦  p» 

(C) 

Fig.  2.  Comparisons  between  single-level  and  hierarchical  attribute  structures,  (a)  Single-level  attribute  structure,  (b) 
Hierarchy  of  attributes.  This  structure  may  be  equivalent  to  that  of  (a),  (c)  Relationship  between  weights. 


and  still  to  make  assessments  in  terms  of  the  hierarchical 
weights  w/  at  any  level  of  the  hierarchy. 

For  the  case  of  decisionmaking  under  outcome  certainty, 
we  know  that  the  ith  outcome  x,  follows  from  the  ith 
alternative.  We  therefore  have  for  the  value  of  the  ith 
alternative,  vk(ai)  the  expression 

o(a,)~  E  0) 

fc-i 

We  say  that  alternative  i  has  a  higher  value  score  than 
alternative  j  when 

N 

tyjmn  ”  mjnAu(7  -  nun  £  P*[b*(a,)  -  «>*(«,)] 

-  minpr[t;(fl1)  -  d(«<)]  2*  0  (2) 

A 

where  A  denotes  the  set  of  imprecise  parameters  over 
which  the  extremization  is  conducted.  This  set  is  restricted 
through  the  eliciting  process  such  that  AsA.p  and  v  are 
vectors  with  components  pk  and  vk.  For  the  realistic  case 
where  weights  and  attribute  scores  for  each  attribute  are 
functionally  independent,  (2)  becomes 

N 

bv,jmn  “  minprK(/,  j)  -  £  P*^*(».  j)  >  0  (3) 

4  *-i 

where 

ntin  [u(a,)  -  t>(a,)]  (4) 

is  a  vector  whose  components  are 

min  fy*(a,) *-1,2, -  -.A. 


We  emphasize  again  that  the  vector  minimization  to  de¬ 
termine  V(i,  j)  is  meaningful  only  when  vk{a,)  is  function¬ 
ally  independent  of  om(a,)  and  um(a;)  for  k  *  m.  In  many 
cases,  the  ok(af)  are  elicited  so  as  to  be  functionally 
independent  of  the  vk(aj),  and  then  we  have 

V(i,  j)  -  minima,)  -  maxima  )  -  V(a.)  -  F(a  ) 

i ’(a,)  »(0|) 

(5) 

where  V  and  V  denote  the  minimum  and  maximum  values 
of  the  value  score  vector  on  the  specified  alternative. 
Determination  of  the  solution  to  (3)  requires  solution  of  a 
linear  program  (LP)  for  each  ij  pair.  If  A  alternatives  exist, 
we  will  need  to  solve  no  more  than  A{A  -  1)  LP’s  to 
resolve  (3).  We  may  need  to  solve  fewer  LP’s  than  this 
since  if  At>j;min  >  0  we  can  assume  that  <  0  without 
solving  the  associated  LP  and  know  that  a,  >  aJ.  Solution 
of  (4)  for  a  specific  /  and  j  will  involve  a  single  LP.  Thus  we 
have  A(A  -  1)  LP’s  to  solve  to  determine  K(i,  j)  for  all  i 
and  j.  Generally,  these  linear  programs  are  extraordinarily 
simple  to  solve  and  result  in  necessary  and  sufficient 
conditions  for  a,  >  a}. 

As  one  simple  example,  let  us  consider  the  alternative 
score  matrix  on  lowest  level  attributes  as  seen  in  Table  II. 
We  assume  that  the  decisionmaker  specified  a  single-level 
attribute  tree  and  is  able  to  estimate  the  weights  0.1  <  p, 

0.2,  0.2  <  p2  $  0.4,  and  0.3  ^  p3  «  0.7.  Of  course,  these 
weights  must  sum  to  one,  and  so  we  have  p(  +  Pj  +  P3  “  1. 
We  have  already  specified  utilities  in  the  max-min  form 
[V,  If  1;  nothing  more  is  needed  here.  To  see  whether  a  >  b, 
we  need  to  see  whether  (3)  is  satisfied.  Thus  we 
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TABLE  II 

Value  Score  on  Attributes 


Attribute 

1 

Attribute 

2 

Attribute 

3 

Alternative 

■ex  score  min 

score 

■ax  score  Bin 

score 

■ax  score  ain 

score 

a 

0 

0 

1 

1 

0 

0 

b 

1 

1 

0 

0 

0.8 

0.6 

e 

0.5 

0.3 

0.4 

0.2 

1 

l 

d 

0.4 

0.2 

0.18 

0.1 

0.7 

0.5 

Fig.  3.  Preference  structure  for  simple  example. 


utility 


Fig.  4.  Hierarchical  tree  of  attributes  and  associated  weights. 


examine  &Vabmm  *=  min(Fa  -  Vb)Tp  3*  0  or 


at  min 


nun  i 
P 


(  o 

T 

1  ' 

T\ 

Pi' 

i 

- 

0 

Pi 

UoJ 

.0.8. 

1 

Pi 

>  0. 


This  is  an  LP  with  bounded  variables,  a  particularly  simple 
form  of  linear  program._We  assign  maximum  weights  to 
the  most  negative  Va  -  Vb  components  until  we  are  all  out 
of  weight.  The  weights  are  found  by  setting  all  weights  at 
their  minimum  value  and  then  allocating  additional  weight 
where  it  will  do  the  most  good.  So  we  use  p1  -  0.2, 
p3  -  0.6,  p2  -  0.2  and  get  AKa6min  -  - 1(0.2)  +  1(0.2)  - 
0.8(0.6)  -  -0.48,  which  is  not  greater  than  zero.  Thus  it  is 
not  possible  to  have  a  >  b.  To  see  if  b  >  a  we  examine 


API 


(  1 

T 

O' 

n 

pi 

0 

- 

1 

pi 

U.0.6. 

.0 

I 

Pi. 

ba  min 


We  use  p2  *  0.4,  p3  -  0.5,  px  -  0.1  and  get  AKtlimin  -  0. 
So  we  conclude  that  b  >  a.  We  determine  that  c>  b  and 
b  >  d,  using  just  this  procedure,  such  that  we  have  the 
preference  structure  of  Fig.  3.  Thus  c  is  the  preferred 
alternative  here. 

It  may  well  be,  however,  that  the  decisionmaker  (DM) 
visualizes  the  attributes  in  a  hierarchical  form  as  shown  in 
Fig.  4.  The  same  alternative  score  matrix  used  earlier  is  still 
appropriate  here.  If  the  DM  feels  comfortable  in  evaluating 
weights  associated  with  attributes  1  and  2  (pt  and  p2)  but 
not  with  3  (p3),  then  a  multilevel  hierarchy  of  attributes 
may  be  assumed.  We  could  attempt  to  assist  the  DM  by 
aggregating  up  the  attribute  tree.  Alternately,  we  could 
determine  whether  or  not  the  relationship  between  attri¬ 
butes  1  and  2  is  sufficient  to  establish  a  single  non- 


TABLEIII 


Attribute 

Attribute 

3  (or  w2)  . 

Alternative 

max  score 

min  score 

■ax  score 

■in  score 

a 

0.8 

0.6 

0 

0 

b 

0.4 

0.2 

0.8 

0.6 

c 

0.44 

0.24 

1 

1 

d 

0.268 

0.14 

0.7 

0.5  — 

dominated  alternative  by  converting  to  the  single-1  el 
weight  form. 

We  will  illustrate  calculations  using  the  first  appror~h. 
Suppose  that  the  DM  says  wj  <  w2.  Then  the  anar^st 
might  use  this  ordinal  expression  or  might  convert  to  a 
cardinal  representation  and  say  that  at  level  1  the  weights 
are  such  that  0  <  w{  <  0.5,  0.5  <  wj  <  1.0.  Followin',  a 
request  to  be  more  explicit,  perhaps  the  decisionm«..er 
indicates  that  0.2  «  w}  <  0.4  and  0.6  <  w22  <  0.8.  We  now 
aggregate  attributes  1  and  2.  Based  on  this  information"^ 
can  calculate  a  maximum  and  minimum  score  for  "tc 
utilities  of  the  alternatives  on  the  second  level  attribute  Wj2. 
We  obtain  the  aggregated  value  score  matrix  showr,.  in 
Table  III.  No  domination  pattern  exists  at  all,  so  we  rr'  !st 
go  further. 

As  often  occurs  in  problems  of  this  sort,  the  level  2 
alternative  scores  are  not  in  proper  0-1  range.  If  the  !"M 
feels  more  comfortable  in  seeing  these  scaled  over  a  •„  -1 
range,  this  can  easily  be  done.  Otherwise,  the  DM  is  asked 
to  consider  the  difference  in  scores  from  max  to  mix  '  on 
attribute  w2  [0.8  on  alternative  a  and  0.14  on  altemativ  f] 
and  express  the  importance  weight  of  the  difference  on 
attribute  3  of  the  difference  between  the  maximum  id 
minimum  scores  on  alternatives  c  and  a.  Suppose  >.!at 
inequalities  of  the  form  0.2  <  Wj2  <  0.35  and  0.65  <  < 

0.8  finally  result.  We  can  then  determine  a  table  of  maxi¬ 
mum  and  minimum  alternative  scores: 


Alternative 

Maximum  Score 

Minimum  Score 

a 

0.28 

0.12 

b 

0.72 

0.46 

c 

0.888 

0.734 

d 

0.6136 

0.374 

Thus  we  have  the  preference  digraph  of  Fig.  5  whic  is 
slightly  different  from  that  obtained  earlier.  The  conclusion 
is  the  same,  however.  Alternative  c  is  the  best  alternative. 
This  particular  approach  used  to  aggregate  up  the  attri>!tte 
tree  yields  only  sufficient  conditions  for  one  altem;-.'ve 
dominating  another  alternative.  It  has  the  advantage, 
though,  of  providing  a  display  of  maximum  and  minii  im 
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TABLE  IV 


Alternative 

Attribute  w* 

max  score  Bin  score 

Attribute 

«ax  score 

3  (ot 

nin  score 

« 

0.8 

0.6 

0 

0 

b 

0.4 

0.2 

0.8 

0.6 

c 

0.44 

0.24 

1 

1 

d 

0.268 

0.14 

0.7 

0.5 

ideal  best 

1 

1 

1 

1 

ideal  worst 

0 

0 

0 

0 

scores  across  alternatives  after  each  aggregation  up  the 
tree.  This  is  not  obtained  through  use  of  the  necessary  and 
sufficient  conditions  of  (3)  and  (4). 

One  way  to  avoid  the  problem  with  the  best  and  worst 
alternative  scores  on  each  attribute  not  being  uniquely 
anchored  on  one  and  zero  after  aggregating  up  the  attri¬ 
bute  tree  may  be  to  define  an  ideal  best  and  an  ideal  worst 
alternative.  The  ideal  best  alternative  will  have  a  score  of 
one  on  each  lowest  level  attribute,  and  the  ideal  worst 
attribute  will  have  a  score  of  zero  on  each  lowest  level 
attribute.  The  DM  should  still  specify  the  weight  bounds 
0.2  <  tv{  ^  0.4  and  0.6  <  <  0.8  obtained  earlier.  Now 

the  aggregation  up  the  attribute  tree  preserves  the  anchor 
over  zero  to  one  on  alternative  scores  for  the  ideal  alterna¬ 
tives,  and  we  have  Table  IV.  Elicitation  of  swing  weights 
might  now  be  more  comfortably  accomplished  than  in  the 
case  where  no  pair  of  alternatives  is  uniquely  anchored  at 
zero  and  one  on  one  or  more  aggregated  attributes. 

The  question  concerning  whether  the  single-level  attri¬ 
bute  tree  or  the  hierarchical  tree  is  more  appropriate  in  a 
given  situation  is  difficult  to  answer.  Previous  studies  on 
this  point  have  not  produced  definitive  guidelines.  Our 
experience  indicates  that  if  the  decisionmaker  is  comfort¬ 
able  with  the  single-level  tree  and  is  willing  to  express 
information  concerning  all  attribute  weights,  then  this 
structure  is  certainly  more  convenient  to  use  and  very 
likely  is  more  appropriate  as  well. 

As  we  have  indicated  in  Fig.  2,  we  can  easily  convert 
from  one  representation  to  the  other.  The  only  essential 
difference  between  the  two  approaches  is  that  it  is  “natu¬ 
ral”  when  aggregating  up  the  attribute  tree  to  indicate 
maximum  and  minimum  scores  on  each  alternative.  Use  of 
these  to  determine  preferences  results  in  only  sufficient 
conditions  for  preference  determination  as  we  have 

min  [o(a  )  -  ufajl  Tw 

>  min  vT{ai)w  —  max  vT(  aJ ) w 
and  we  use  the  expressions  on  the  right  side  of  this 
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inequality  to  determine  the  minimum  and  maximum  scores 
on  each  alternative  for  each  aggregated  attribute. 

Using  necessary  and  sufficient  conditions  for  preference 
determination  is  highly  desirable.  The  way  around  the 
potential  dilemma  noted  earlier  is  to  use  the  best  ideal  and 
worst  ideal  alternative  concept  as  prompts  to  the  de¬ 
cisionmaker.  These  always  propagate  through  the  tree  as 
the  best  and  worst  alternatives  and  will  always  be  anchored 
at  attribute  scores  of  one  and  zero.  We  use  these  as  anchors 
for  the  weight  elicitation  effort.  All  computations  are  made 
using  (3)  and  (4)  such  that  we  always  obtain  necessary  and 
sufficient  conditions  for  preference  condition  determina¬ 
tion. 

B.  Decisions  Under  Risk 

For  the  decision  under  risk  situation,  we  calculate  the 
expected  utility  of  alternative  a  from 

EU(a)=  ZP,(a)Vt{a)  (6) 

/-I 

where  Af  outcome  states  can  result  from  alternative  a.  State 
xt  occurs  with  probability  P,(a),  and  the  utility  of  this  state 
is  Uj(a).  This  utility  function  will  generally  be  a  multiat¬ 
tribute  utility  function.  When  additive  independence  con¬ 
ditions  are  satisfied  we  have 

UM  -  E  PjUjAa)  (7) 

7-1 

where  Ujt{a)  is  the  utility  of  the yth  attribute  of  outcome 
state  i  associated  with  alternative  a  and  py  is  the  trade-off 
weight  associated  with  the  y  th  attribute.  Generally,  the 
decision  situation  should  be  structured  such  that  the  weights 
are  alternative  and  outcome  state  independent.  If  this  is 
not  the  case,  there  is  very  likely  a  modeling  deficiency  in 
the  framing  of  the  decision  situation  structural  model. 

Combination  of  (6)  and  (7)  results  in 

EU(a)  =*  £  E  PMVjMPj  ■  PT{a)U(a)p  (8) 

i-i y-i 

whererr(o)  and  p  are  vectors  of  dimension  M  and  N ,  and 
U(a)  is  an  M  X  N  vonNeuman  Morgenstem  cardinal  util¬ 
ity  function  expressed  as  a  matrix.  Alternative  a  is  guaran¬ 
teed  to  be  preferred  to  alternative  b  if 

min[pT{a)U{a)- PT{b)U(b)]p>0  (9) 

where  A  represents  the  set  of  all  possible  values  that  the 
parameters  p(a),p(b),  U(a),  U(b),  and  p  can  assume. 

The  simplest  case  occurs  when  probabilities  and  utilities 
are  known  precisely  and  only  weights  are  imprecise.  We 
obtain  A(A  -  1)  linear  programs  to  solve  for  all  possible 
alternative  preferences  is  the  weight  set  inclusion  is  de¬ 
scribed  by  linear  inequalities.  We  obtain  necessary  and 
sufficient  conditions  for  preference  inequalities.  In  a  simi¬ 
lar  way,  if  only  the  probabilities  or  only  the  across  attri¬ 
butes  are  imprecise,  we  may  solve  a  set  of  A(A  -  1)  linear 
programs  to  obtain  necessary  and  sufficient  conditions  for 
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alternative  pair  preferences  if  the  precision  is  expressed  as 
a  set  of  linear  inequalities. 

If  probabilities  are  known  precisely,  then  we  may  rewrite 

(9)  as 

minyr(fl,  b)p  >  0  (10) 

H- 

where 

min  [PT(a)U(a)  ~  PT(b)U(b)]  (11) 

L'(a).  t'(h) 

and  where  the  utilities  of  alternative  a  and  b  on  the  ith 
attribute  are  functionally  independent  of  those  on  the  y  th 
attribute  for  i  #  j.  Thus  each  column  in  (11)  can  be  opti¬ 
mized  independently  of  one  another.  There  are  A(A  -  1  )N 
linear  programs  to  solve  to  specify  (11)  and  A(A  -  1) 
linear  programs  to  determine  the  preference  inequalities  of 

(10)  if  parameter  imprecision  is  expressed  by  linear  in¬ 
equalities.  We  then  can  obtain  necessary  and  sufficient 
conditions  for  preferences. 

In  all  other  cases, 

a)  utilities  specified  precisely,  probabilities  and  weights 
imprecisely; 

b)  weights  specified  precisely,  probabilities  and  utilities 
imprecisely; 

c)  weights,  probabilities,  and  utilities  specified  impre¬ 
cisely, 

obtaining  necessary  and  sufficient  conditions  for  optimal¬ 
ity  of  linear  programming  solutions  will  generally  not  be 
possible  unless  the  imprecision  can  be  expressed  by  means 
of  simple  numerical  inequalities,  i.e.,  0.2  <  P,(a)  0.35. 

In  case  b),  we  can  obtain  some  desirable  simplifications. 
Probabilities  and  weights  are  constrained  by  the  sum  to 
one  property  but  utilities  are  not.  When  we  have  simple 
numerical  inequalities  on  utilities,  we  can  rewrite  (9)  as 

min  \PT{a)U(a)  -  PT{b)U{b)\p  >  0  (12) 

P(u).P(b).w  J 

where 

U(a)  =  minf/(fl),(7(fj)  -  maxf/(6).  (13) 

This  will  enable  us  to  obtain  more  desirable  solution 
characteristics.  In  case  b),  where  probabilities  are  the  only 
other  imprecise  parameters,  we  can  solve  a  simple  set  of 
linear  programming  problems  to  obtain  necessary  and  suf¬ 
ficient  conditions  for  alternative  preferences. 

In  cases  a)  and  c),  where  both  probabilities  and  weights 
are  imprecise,  it  seems  that  no  realistic  way  exists  in  which 
to  obtain  solution  for  the  preference  inequalities  by  solving 
sets  of  linear  programming  problems.  This  is  a  consider¬ 
able  complication  because  of  the  solution  complexity  asso¬ 
ciated  with  nonlinear  (quadratic)  programming  problems 
and  the  fact  that  we  usually  will  not  obtain  both  necessary 
and  sufficient  conditions  for  preference  inequalities  to  hold. 
We  can  place  a  lower  bound  on  the  preference  inequalities 
for  (9)  in  these  cases.  If  this  lower  bound  is  greater  than 
zero,  then  we  have  sufficient  but  not  necessary  conditions 
for  a  given  alternative  preference.  Even  though  we  may 
determine  the  existence  of  alternative  preferences  through 


solution  of  linear  programs,  the  fact  that  we  establish  only 
sufficient  conditions  gives  cause  for  concern  as  other  si  i- 
cient  conditions  may  well  exist  which  yield  consider:.- Iv 
stronger  preference  relations. 

From  the  foregoing  discussion  we  see  that  it  is  a  r~~i- 
tively  straightforward  matter  to  incorporate  imprecision  in 
the  form  of  linear  inequalities,  into  any  combination  of 
utility  scores  for  lowest  level  attributes,  probabilities  of 
event  outcomes,  and  attribute  weights  as  long  as  probai  pi¬ 
ties  and  weights  are  not  simultaneously  imprecise.  If  inis 
occurs,  we  must  solve  quadratic  programming  problems 
and  are  no  longer  able  to  get  necessary  and  suffic  at 
conditions  for  preferences. 

Appendix 

The  simplest  forms  of  ARIADNE  were  designed  for  use 
in  situations  in  which  alternatives  scores  on  lowest  l-'  el 
attributes  and  probabilities,  if  appropriate,  are  preci  ly 
known.  The  intent  is  to  allow  the  decisionmaker  to  specify 
precise  attribute  weights  in  a  bottom-up  fashion  so  as  to  be 

able  to  aggregate  up  the  attribute  tree.  Generally,  this _ ill 

result  in  greater  strength  to  the  partial  preference  orde...ig 
among  alternatives.  Ultimately,  a  scalar  additive  multiat¬ 
tribute  utility  (MAUT)  function  results.  Although  the  j  o- 
cess  of  obtaining  this  scalar  MAUT  function  will  genet.  Jy 
be  quite  different  from  that  used  in  conventional  MAUT. 
the  substantive  results  should  be  the  same.  A  rather  com¬ 
plete  discussion  of  this  simplest  decision-under-certa_t\ 
version  of  ARIADNE  is  contained  in  [17]. 

Our  initial  efforts  involving  single-stage  decision  aiding 
under  uncertainty  were  based  on  precise,  specificatiorof 
not  necessarily  all  alternative  scores  on  lowest  level  a..\i- 
butes  and  the  use  of  stochastic  dominance  concepts.  Aggre¬ 
gation  up  the  attribute  tree  by  means  of  elicitatior— of 
partial  preference  information  concerning  weights  was  i  ;d 
to  increase  the  strength  of  preference  specificity.  Twc 
forms  of  stochastic  dominance  have  been  considered  as 
described  in  [18],  [19]. 

The  stochastic  dominance  concepts,  especially  second- 
order  stochastic  dominance,  are  computationally  very  time 
consuming  for  more  than  just  a  few  attributes.  We  U've 
discovered  and  investigated  a  strong  second-order  stochas¬ 
tic  dominance  bound  that  greatly  reduces  computationa 
complexity.  However,  our  research  has  shown  that  speVfi 
cation  of  bounds  on  parameters,  such  that  linear,  oi 
quadratic  programming  techniques  may  be  used  to  identify 
a  dominance  structure,  appears  behaviorally  much  n  -  rt 
realistic  as  well  as  computationally  much  simpler  i  ar 
stochastic  dominance  based  approaches.  Here,  expectec 
value  stochastic  dominance  is  used  in  the  uncertain  cas**  A 
rather  general  description  of  the  analytical  constructs  p 
porting  this  bounded  inequality  version  of  ARIADNl  i: 
contained  in  (20). 

Development  of  necessary  and  sufficient  condition:'- „'o 
alternative  preferences  with  parameter  information  v-'n 
straints  expressed  as  linear  inequalities  is  contained  in  [21] 
Further  extensions  of  these  analytical  constructs,  inclu  '  n; 
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an  inverse  decision  aiding  approach  to  enable  learning  of 
judgmental  weights  in  terms  of  skill-based  wholistic  prefer¬ 
ences.  are  contained  in  {22].  The  use  of  structural  parame¬ 
ter  imprecision  concepts  in  the  bottom-up  and  top-down 
development  of  attribute  trees  is  described  in  [23],  [24], 

An  overview  of  the  concept  is  presented  in  [25].  Organi¬ 
zational.  behavioral,  and  methodological  concerns  which 
have  influenced  system  design  are  contained  in  [26].  Initial 
analytical  and  algorithmic  developments  which  serve  as  the 
basis  for  extensions  of  ARIADNE  to  the  sequential  de¬ 
cisionmaking  case  are  contained  in  [27]— [30].  Finally,  an 
evaluation  of  the  decision  support  system  is  discussed  in 

(31]. 
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ABSTRACT 

We  examine  a  finite  state,  finite  action  dynamic  program  having  a  specially 
structured  one  transition  value  function  that  is  dependent  on  an  imprecisely  known  para 
meter.  For  the  finite  horizon  case,  we  also  assume  that  the  terminal  value  function 
is  affine  in  the  imprecise  parameter.  The  special  structural  characteristics  of  the 
one  transition  value  function  and  the  terminal  value  function  have  been  assumed 
in  order  to  model  parameter  imprecision  associated  with  the  problem's  reward  or 
preference  structure.  We  assume  that  the  parameter  of  interest  has  no  dynamics, 
r?  rev/  information  about  ’’ts  vclue  is  received  cnce  the  decision  process  bcgir.s, 
and  its  imprecision  is  described  by  set  inclusion.  We  seek  the  set'  of  all  parameter 
independent  strategies  that  are  optimal  for  some  value  of  the  imprecisely  known 
parameter.  We  present  a  successive  approximations  procedure  for  solving  the  finite 
horizon  case  and  a  policy  iteration  procedure  for  determining  the  solution  of  the 
discounted  infinite  horizon  case.  These  algorithms  are  then  applied  to  a  decision 
analysis  problem  with  imprecise  utility  function  and  to  a  Markov  decision  process 
with  imprecise  reward  structure.  We  also  present  conditions  which  guarantee  the 
existence  of  a  parameter  independent  strategy  that  maximizes,  with  respect  to  all 
other  parameter  invariant  strategies,  the  minimum  value  of  its  expected  reward 
function,  where  the  minimum  is  taken  over  all  possible  parameter  values. 


*  This  research  has  been  supported  by  ONR  Contract  N00014-80-C-0542,  Work  Unit 
Number  N197-065,and  NSF  Grant  ECS-801 8266 . 


I  INTRODUCTION 


Standard  models  of  sequential  decisionmaking  assume  that  the  parameters 
of  the  model  are  known  precisely  and  do  not  vary  over  the  problem  horizon.  These 
parameters  are,  for  example,  terminal  node  utility  values  and  chance  node  probabilit'- 
for  decision  analysis  problems  {Keeney  and  Raiffa,  1976)  and  single  stage  rewards, 
terminal  stage  rewards,  the  discount  factor,  and  transition  probabilities  for 
Markov  decision  processes  (Bertsekas,  1976).  Such  parameters,  however, 

1.  may  be  only  imprecisely  known, 

2.  may  change  value,  perhaps  in  an  uncertain  manner,  over  the  problem's 
planning  horizon, 

3.  may  be  subject  to  an  estimation  process  that  is  based  on  parameter  value 
information  which  arrives  sequentially. 

A  standard  procedure  for  considering  a  parameter  subject  to  dynamic  change  has  been 
state  augmentation  (Bertsekas,  1976);  probabilistic  and  nonprobabil istic  state 
dynamics  are  described  in  (Bertsekas,  1976)  and  in(Bertsekas  and  Rhodes,  1973; 
Figueras,  1972;  White,  1983),  respectively.  Both  probabilistic  (Van  Hee,  1978; 
Sagalovsky,  1982;  Cyert  and  DeGroot,  1975)  and  nonprobabil istic  (Sworder,  1966; 
Bertsekas  and  Rhodes,  1973;  Figueras,  1972)  approaches  to  problem  formulation  and 
analysis  have  been  taken  that  involve  (nondynamic)  parameter  imprecision  and 
sequential  estimation.  Parametric  programming  (Viswanathan  et  al.,  1977),  successive 
approximations,  and  policy  iteration  (White  and  Kim,  1980)  have  been  applied  to 
analyze  the  vector  criterion  Markov  decision  process,  where  the  imprecisely  known 
parameter  is  a  vector  of  importance  weights  that  has  no  dynamics,  is  not  subject 
to  sequential  estimation,  and  is  known  only  to  have  nonnegative  components  and 
satisfy  a  sum-to-one  property. 

In  most  sequential  decisionmaking  or  control  models  considered  to  date, 
attention  has  been  directed  to  imprecise,  estimated,  and/or  dynamic  parameters  that 


are  associated  with  state  dynamics  and/or  the  observation  mechanism.  Notable 
exceptions  are  due  to  Cyert  and  DeGroot  (1975)  and  White  (1983)  for  parameters 
in  the  utility  function  and  to  Smallwood  (1966)  and  Veinott  (1969)  for  the 
discount  factor.  We  remark  that  Kreps  (1977)  and  Meyer  (1977)  have  assumed  that  the 
utility  function  is  allowed  to  change  in  an  uncertain  manner  over  time;  however,  these 
changes  depend  on  a  probabilistically  described  state.  Both  Kreps  and  Meyer  assume 
that  the  functional  relationship  between  utility  and  state  is  precisely  known  over 
the  entire  planning  horizon. 

In  this  paper,  we  examine  a  finite  state,  finite  action  dynamic  program 
having  a  specially  structured  one  transition  value  function  that  is  dependent  on 
an  imprecisely  known  parameter.  Parameter  imprecision  is  described  by  set  inclusion. 
For  finite  horizon  problems,  we  also  assume  that  the  terminal  value  function  is 
affine  (linear  plus  a  constant)  in  the  imprecise  parameter.  The  specific  functional 
form  of  the  one  transition  value  function  and  the  terminal  value  function  have 
been  selected  in  order  to  model  parameter  imprecision  associated  with  the  reward 
or  preference  structure  of  the  problem  for  the  case  where  no  new  information 
regarding  the  parameter's  value  becomes  available  over  the  planning  horizon  and 
where  the  parameter  has  no  dynamics.  Our  motivation  for  examining  such  a  problem 
formulation  is  due  to  the  following  perceptions: 

1.  rewards  and  preferences  can  be  difficult  to  quantify  precisely, 
particularly  when  multiple,  conflicting,  and  noncommensurate 
objectives  are  being  considered  and/or  preference  assessment  is  involved, 

2.  set  inclusion  is  a  particularly  simple  description  of  parameter  imprecision 
that  is  relatively  easy  to  justify  behaviorally  in  the  context  of  preference 
assessment. 


W v\- 
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We  remark  that  set  inclusion  is  an  often  used  model  of  parameter  imprecision 
in  the  single  stage  decisionmaking  1’terature;  see  for  example,  Sarin  (1977a,  1977b), 
Fishburn  (1965),  White  et  al .  (1983),  and  their  references.  The  results  presented 
here  represent  to  some  extent  an  extension  of  this  work  to  the  sequential  case  and 
a  generalization  of  the  above  referenced  results  for  the  vector  criterion  Markov 
decision  process. 

The  paper  is  organized  as  follows.  Results  for  the  finite  horizon  case  are 
presented  in  Section  2.  Under  suitable  assumptions  on  the  functional  form  of  the 
one  transition  value  function,  we  show  that  the  optimal  reward  functions  are  all 
affine  and  convex  in  the  unknown  parameter.  This  result  is  used  to  develop  a  simple 
computational  algorithm  that  is  reminiscent  of  a  successive  approximation  algorithm 
due  to  Smallwood  and  Sondik  (1973)  for  the  finite  horizon,  partially  observed 
Markov  decision  process.  The  intent  of  this  algorithm  is  to  identify,  on  the  basis 
of  the  given  description  of  parameter  imprecision,  the  set  of  all  strategies  that  may 
be  optimal,  or  equivalently,  to  eliminate  all  clearly  suboptimal  strategies.  This 
algorithm  is  applied  to  a  decision  analysis  problem  and  to  a  Markov  decision  process 
problem  in  Section  3.  The  infinite  horizon,  discounted  case  is  examined  in  Section  4. 
A  policy  iteration  algorithm,  similar  to  a  policy  iteration  algorithm  presented  in 
Sondik  (1978),  is  developed  and  applied  to  a  Markov  decision  process  problem.  Again, 
the  intent  of  this  algorithm  is  to  determine  the  set  of  all  strategies  that  are 
optimal  for  some  feasible  parameter  value.  In  Section  5,  results  are  presented 
for  determining  a  best  maximin,  parameter  invariant  strategy  for  the  infinite  horizon, 
discounted  case.  Conclusions  are  presented  in  the  final  section. 


II  THE  FINITE  HORIZON  CASE 

We  now  present  a  finite  horizon,  finite  state  and  action  dynamic  program 
having  a  specially  structured  one  transition  value  function  and  terminal  value 
function.  Our  approach  to  problem  definition  is  similar  to  that  of 
Denardo  (1967).  Consider  the  following  definitions: 


K  <  «  represents  the  number  of  stages  or  decision  epochs  of  the  problem, 

Sk  is  the  finite  state  space  at  stage  k  =  0,1,..., K, 

Ak(i)  is  the  finite  action  space  at  stage  k  =  0,1,...,K-1  when  the  state 
at  stage  k  is  ieSk, 

PCfR  is  che  set  of  ail  possible  parameter  values,  assumed  to  be  convex, 

is  the  set  of  all  bounded,  real  valued  functions  on  Sk  *  P,  k=0,l,...,K, 

hk:SkxPx\xVk+l  ^  1S  the  bounded  one  transition  value  function  at  stage 
k=0 ,!,..., K- 1 , 

fKeVK  is  the  terminal  value  function, 

(parameter  dependent) 

Ak  is  the  set  of  allA policies  6:  S^*P+A^,  such  that  6(i ,p)eAk(i ) ,k=0,l ,. . . ,K-1 

Hk6:Vk+l^Vk  is  defined  as  [Hk6v](i,p)  =  hk[i  ,p,6(i  ,p),v]  for  each 
AeA., .  k=0 ,1 ,. . .  ,K-1 , 

i\ 

Hk:Vk+l^Vk  1S  de^lned  as  Hkv  =  sup  Hk  v,  k=0,l ,. .. ,K-1 , 

f k : Vfc-^R  is- the  optimal  reward  function  from  stage  k  to  the  end  of  the  planning 
horizon, 

a  sequence  of  policies  -rr={ 6q , . . . , k=0,l ,. . .  ,K-1 ,  is  called  a  strate> 


We  remark  that  the  dynamic  programming  equation  for  this  problem  is 


\-Vv 


fk(i,p)  =  max  {hk(i,p,a,fk+1)l 


a^Ak(i) 


k=0,l ,. . . ,K-1 , 
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which  we  express  more  succinctly  as  ,  k=0,1,...,K-l.  If  the  strategy 

7T«{ 6* , . . .  ,6*_.| >  is  such  that  fk=Hkg*fk+1 ,  for  all  k=0,l,...  ,K-1,  then  we  call 

k  , 

ir*an  optimal  strategy.  Reference  to  the  examples  in  Section  3  may  help  to  ex¬ 
plicate  our  notation. 

Our  objective  is  to  determine  the  set  of  all  parameter  independent  strategies  __ 
that  are  optimal  for  some  peP.  This  collection  of  strategies  represents  the  set 
of  all  strategies  that  may  be  optimal,  given  that  parameter  imprecision  is  des¬ 
cribed  by  the  set  P.  We  determine  this  collection  of  strategies  from  the  optimal  ~  ' 
strategy  ir={6*,. ..  ,6^}  in  the  following  manner:  {Xk,  k*0,l,...,K-l},  V'Sk*Ak’ 
Ak(i)eAk(i),‘  may  not  be  excluded  as  a  candidate  for  an  optimal  parameter  independent 
strategy  if  there  exists  a  peP  such  that  X^(i)  =  <$  £  ( i  > P )  for  ^*0*1 > • . • »K-1 •—  „ 

We  observe  that  it  is  sufficient  to  determine  an  optimal  strategy  and  the  optimal 
reward  functions  in  order  to  achieve  the  above  objective.  The  determination  of  an 
optimal  strategy  and  the  optimal  reward  functions  represents  the  primary  emphasis  of~,  ~ 
this  section  and  of  Section  4.  .. 

Assume  throughout  this  section  that  the  following  assumptions  hold: 

hJ:SxA+  R,  h£:SxA+  |RN,  and  h^:SxA->S  -j  ^ 

Al.  For  each  k=0,l . ,K-1 ,  there  are  functions  .  such  that 

hk(i,0,a.v)  •  hjo.a)  +1^(1  .«)„»„  +  I  ^(i  .»)jV(J.p). 

n~'  Jeik+1 

*  • 

v: 

A2.  For  each  icS^,  aeAk(i),  and  jcS^,  hj^  ( i  ,a )  ^>0 ,  k=0,l ,. . .  ,K-1 .  — 

—1  —2 

A3.  There  are  functions  h  and  h  such  that 

J 

fK(i,0wr’(i)  + 1 fWffv  ..  .. 

n=  I  *.*  v, 
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We  remark  that  these  assumptions  appear  to  be  quite  reasonable  for  a  broad 
class  of  decision  analysis  problems  and  Markov  decision  processes  having  imprecisely 
known  parameters  associated  with  their  preference  or  reward  structure,  a  claim  sup¬ 
ported  by  the  examples  in  Section  3.  We  now  present  two  results  that  will  lead  to 
the  development  of  a  computational  algorithm  for  this  class  of  dynamic  programs. 


LEMMA  1:  Let  ke{0,l .  ,K-1}.  Assume  veVk+.j  is  piecewise  affine  and  convex  in 
p  on  P  for  each  ieS^+-|.  Then,  H^v  is  piecewise  affine  and  convex  in  p  on  P  for 
each  ieSk. 

Proof:  Note  thac  it  is  sufficient  Lo  shew  clut  hk(i,p,a,v)  is  piecewise  affine  and 
convex  in  p  for  each  pair  (i .aJeS^xA^.  Since  veVk+i  is  piecewise  affine  and  convex 
in  p  for  each  ieSk+p  then  for  each  ieSk+-|,  there  is  a  set  A(i)  such  that 

v(i,p)  =  max{a+Yp:(a,Y)eA(i)}. 

It  then  follows  that 


i  o  3 

hk(i  ,p,a,v)  =  h^(i  ,a)+hk(i  >a)p+£jhk(i  ,a)j.max{a+Yp:  (a,Y)eA(j)}. 


Since  the  sum  of  nonnegatively  weighted  piecewise  affine  and  convex  functions  is 
piecewise  affine  and  convex, hk (i ,p, a, v)  is  piecewise  affine  and  convex  in  p  for 
each  pair  (i,a).  I — > 


PROPOSITION  1:  For  each  k=0,l ,. . . ,K,fk  is  piecewise  affine  and  convex  in  p  on  P 
for  each  icS^. 
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Proof:  The  result  is  true  by  assumption  for  k=K.  Backward  induction  and  the 
result  in  Lemma  1  imply  that  the  result  is  true  for  k=0,l . K-l.  Q 

The  above  results  suggest  the  following  computational  procedure  for  deter¬ 
mining  the  fk: 

0.  Define  AK(i}={(h1(i),  E^i))};  set  k=K-l. 

1.  Define  Ak(i,a)  as  the  set  of  all  pairs  (a'.y1),  where 

a'sh||(i  ,a)  +  IjhJ(1,a)joU) 

Y,ah^(i  ,a)  +  Ijh^d  ,a)j-Y( J ) 

UU)  »vtj)) 

and  where  A  eA^fj).  Eliminate  all  pairs  (a',y')  inAk(i,a) 
that  do  not  achieve  the  maximum  in  max{a'+y'p: (a1 ,y' )eAk(i ,a)}  for 
some  value  of  peP.  (See  Smallwood  and  Sondik  (1973)  for  a  related 
elimination  procedure.) 

2.  Define  A^(i )=UgAk(i ,a).  Eliminate  all  pairs  (a',y')  in  Ak(i)  that 
do  not  achieve  the  maximum  in  maxCa'+y'p: (o' ,y' )eAk(i )}  for  some 
value  of  peP. 

3.  If  k=0,  stop;  if  not,  set  k=k-l,  and  go  to  Step  1. 

We  remark  that 

fk(i ,p)=max{a+yp:(a,y)cAk(i)} 


2- 


4 


h  ft  ft  yt 

and  that  optimal  strategy  6£(i,e)»a  if  fk(i.p)=a  +y  p  and  if  (a  ,y  )eAk(i,a).  Thus, 
the  above  algorithm  can  be  used  to  provide  both  { f^ ,  k*0,l,...,K}  and  {<5£,  k=0,l,...,K- 
Note  also  that  (2)  is  easily  derived  from  (1)  by: 

a.  replacing  A(i)  with  (i )  in  (1),  ;y;v 

b.  replacing  max{a+YP*.(a,Y)eAk+^(j)}  by  a(j)+Y(j)p  for  (a(j)  ,y( jJJeA^-jt  j) ,  r_f  .y 

c.  collecting  terms,  and 

d.  considering  every  combination  of  pairs  in  Ak+.j(j),  jeS. 


“.NV-V-v 
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Ill  EXAMPLES:  FINITE  HORIZON  CASE 

We  now  consider  two  areas  of  application  of  the  results  presented  in  Section 

\ 

2,  decision  analysis  and  Markov  decision  processes,  and  illuminate  these  results 
with  two  associated  numerical  examples. 


Decision  analysis.  Assume  that  the  given  decision  tree  has  a  maximum  of  K 
stages.  Add  the  appropriate  number  of  decision  nodes  with  single  actions  and 
chance  nodes  with  single  outcomes  to  branches  having  less  than  K  stages  in  order  —  - 
to  insure  all  branches  have  exactly  K  stages. 

Let  z^+1  be  the  outcome  received  after  having  chosen  action  a^,  k=0,l ,. . . ,K-1 . 
Define  sk={ag,z^  ,a^  ,Z2,. . .  ,ak  -j  ,zk>,  and  assume  all  probabilities  of  the  form  ~ 
p(zk+1|sk,ak),  and  hence  p(sR+1 | sk,ak) ,  are  known.  Let  fK(sK)=u(sK) ,  where 
u:SK-*-R  is  a  utility  function.  The  function  u  ascribes  a  utility  value  to  all 
possible  terminal  nodes  in  the  decision  tree,  each  branch  of  which  is  uniquely 

associated  with  an  element  in  S^.  >;■ 

*>  v! 

We  consider  two  cases,  the  first  of  which  assumes  that  all  there  is  known 

M  JI 

about  u  is  that  the  collection  {u(sK)>  is  a  member  of  a  set  Ud*  ,  where  N=7rSk.  j 
For  this  case,  h^=h^=F1=° »h^(i  »a) j=p(sk+i=0 1 sk=i  »ak=a)  ’  and  )n=1  (=0)  if 
i=n(if  i^n). 

With  respect  to  the  second  case,  we  assume  that  u(s^)=^_iWmurn(sk) ,  where 

um:^K"^  tlie  utility  function  associated  with  the  attribute,  M  is  the  number  >; 

of  attributes  under  consideration,  the  attributes  are  assumed  additive  independent,..  >•- 

w  >0  is  the  importance  weight  of  attribute  m,  and  T  w  =1 .  Assume  each  um  is  —  - 

m—  Lm  m  m 

known  exactly  and  all  that  is  known  about  the  vector  of  importance  weights 

M  12  —1  **  ■"*. 

w={w  >  is  that  it  is  a  member  of  the  set  WdR  .  For  this  case,  h^hSh  =0, 

m  —  k  k  . 
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II: 


% 


EXAMPLE  1.  Consider  the  decision  tree  in  Figure  1,  which  is  based  on  the  ore 
buying  example  presented  in  Brown  et  al.  (1974),  Chapter  2.  Assume  all  that  is 
known  about  the  single  attribute  terminal  utility  values  u^ ,  i=l,...,9,  is: 


u-|e[0. 7,  1.0] 

u2=0 

u2=0.43 

u4=ul 

u5=0 

ug=0.46 

Uye[G.7,  1.0],  U^u-j 

ug=0.01 
ug=0.43  . 


Let  P={(p-|  ,p2):p-|  ,p2e[0.7,  1.0]  and  p2>p^ > ,SQ={01 } ,  S^={11 ,. . .  ,15},  and 
S2={21 ,. . .  ,29} ,  where  these  states  are  defined  in  Figure  1.  Associate  p-j  with  u-j 
and  p2  with  Uy.  The  functions  f^  and  the  optimal  strategy  ir^  as  a  function  of  state 
and  parameter  value, are  given  in  Table  I.  We  see  there  are  two  strategies  that  are 
possibly  preferred,  given  the  available  utility  value  information: 


x1(01)=aj,  X1 (11 )=a| ,  X1 (12)=a| , 
X2(01)=3q. 
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Markov  decision  processes.  Consider  the  following  stationary,  finite  horizon 
Markov  decision  process.  Let  P^j(a)  he  the  probability  of  making  transition  from  __ 
state  i  to  state  j  at  the  next  stage,  given  action  a  was  just  selected.  If  at 
stage  k  the  system  is  in  state  i  and  action  a  was  just  selected,  a  reward  of 
r(i,a)  is  assumed  to  be  accrued,  for  k=0,l .... ,K-1.  If  at  the  terminal  stage  K, 
the  system  is  in  state  i,  then  a  terminal  reward  F(i)  is  accrued.  The  case  where 
the  terminal  reward  is  imprecisely  known  can  be  treated  in  a  manner  analogous  to 
the  above  decision  analysis  results.  We  therefore  assume  F(i)  is  precisely  known,  - 
and  hence  h  (i)=r(i)  and  h  ( i )n=0  for  all  i  and  n.  Assume  all  that  is  known  about  ; 

M  ji 

r={r(i,a)}  is  that  it  is  a  member  of  the  given  set  RdR  ,  where  N^Sx^A.  Then, 

h2(i  ,a)n=l(=0)  if  n=(i ,a)  (it  n/(i,a)).  -* 


EXAMPLE  2:  Consider  the  following  Markov  decision  process,  which  is  based  on  the 
maintenance-model  example  presented  in  Hillier  and  Lieberman  (1980),  Chapter  13.  ^ 

i 

Let  K=2,  S={ 1 ,. . . ,4} ,  A={1 ,2,3} , 


{r(i ,a}}= 


,  F(i )=0, 


tpy(i»= 


Pi2(2)=l  for  all  i,  p^ ^ (3)=1  for  all  i ,pje[-6,-2],  p2e[-7,-4],  and  P2<_Pl .  Table  2  . 
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presents  the  and  ir*for  this  example.  We  note  that  there  are  three  strategies 
that  are  possibly  preferred,  based  on  the  given  reward  structure  information, all 
three  of  which  select  action  1  in  states  1  and  2  and  action  3  in  state  4  for  both 
k=0  and  k=l : 

Xq(3)=3,  x](3)=l 
*q(3)»2,  xf (3)=1 
Xq(3)=2  ,  xf(3)=2 

where  the  subscript  designates  stage.  The  fourth  possibility,  Xq(3)=3  and 
X^(3)=2,  produces  an  optimal  expected  total  reward  function  identical  to  the  above 
strategies  only  when  p-|=-4  and  p2=-3,  is  inferior  to  at  least  one  of  the  above 
strategies  otherwise,  and  thus  has  been  deleted.  The  analysis  has  therefore 
eliminated  all  but  three  of  the  81  possible  strategies  for  this  Markov  decision 

□ 


process. 


IV  THE  INFINITE  HORIZON,  DISCOUNTED  CASE. 


We  now  consider  the  case  where  K=®  and  where  Sk,  Ak,  hk,  and  hence  £>k,  V^,  Hk6, 
and  Hk  are  all  stage  invariant.  We  continue  to  assume  that  assumptions  Al  and  A2 
hold  and  additionally  assume  the  following: 


Q 

A4.  There  is  a  e,  0<e<l ,  such  that  £je$h  (i for  all  ieS  and  aEA(i). 


Assumptions  A2  and  A4  imply  that  Hr,  for  all  <SeA,  and  H  are  isotone  contractions 

6  — 

on  V  with  respect  to  the  supremum  norm,  and  hence  there  exist  unique  fixed  points 
fs  and  f  of  the  operators  and  H,  respecti vely.  Our  objective  is  to  determine 

f  and  5*such  that  f=Hf=H,*f,  L 

° 

A  variety  of  computational  procedures  have  been  used  to  determine  f  and  6 
for  the  h  =0  case:  linear  programming  (d'Epenoux,  1960),  successive  approximations 
(White,  1969),  policy  iteration  (Howard,  1960),  and  various  modifications  and  J 
combinations  of  the  latter  two  procedures  (Puterman  and  Shin,  1978,  1982; 

Schweitzer,  1971,  Platzman  et  al.,  1982).  Viswanathan  et  al .  (1977)  have  applied 
parametric  linear  programming  and  White  and  Kim  (1981)  have  applied  successive  J 
approximations  and  policy  iteration  in  order  to  determine  f  and  5  for  the  case 
where  h^=0,  P={p:pn^0,  £nPn=l},  and  [jh^(i,a)j=6  for  all  i  and  a,  i.e.,  the  vector 
criterion  Markov  decision  process.  The  latter  approaches  were  based  on  algorithms  _ 
due  to  Smallwood  and  Sondik  (1973)  and  Sondik  (1978).  We  remark  that  Henig 
(1978)  has  shown  that  for  the  vector  criterion  Markov  decision  process,  the 

6m* 

set  of  all  stationary,  parameter  invariant  policies  generated  by  6  produces 

We  conjecture  that  the. 

all  extreme  points  of  the  convex  hull  of  the  nondominated  set.^  parametric 

programming  approach  presented  by  Viswanathan  et  al .  (1977)  is  easily  extended 

to  consider  our  more  general  problem  formulation,  as  is  the  successive  approxi-  -* 

motivate  and 

mations  procedure  presented  earlier.  We  now^present  a  generalized  policy  ^ 

iteration  algorithm  for  the  solution  of  the  infinite  horizon  case. 


(necessarily  finite) 

Define  A  as  the^set  of  all  parameter  independent  policies  A:S-*-A,x(i )eA(i ) 
for  all  ieS,  and  let  f^  be  the  fixed  point  of  H^.  INSERT  A 

0,  Let  A^A  be  given,  and  set  n=0. 

1.  Let  f  (i,p)=  maxf  (i,p),  ieS,  peP. 

2.  Remove  any  A  from  A„  that  does  not  achieve  the  above  maximum  for  some 

n 

ieS  and  peP. 

3.  Let  A  jiCA  be  composed  of  the  set  of  all  A  that  for  some  pePachieves 

n+i—  _  /So 

the  maximum  in  Hfn  for  all  ieS.  If  Af  can  be7 selected,  then  set 

4.  If  A  X,*A  ,  then  stop.  Otherwise,  set  n=n+l ,  and  go  to  Step  1. 

n+l  n 

We  remark  that  by  choosing  An+1  in  Step  3  to  equal  An  whenever  possible,  we 

eliminate  the  possibility  of  cycling  due  to  any  nonuniqueness  in  achieving  the 

maximum  in  H7  .  INSERT  3 
n 

An  alternative  approach  to  describing  the  above  algorithm  is  to  eliminate 
Step  2  and  to  ask  in  Step  3  1*  the^e  exists  a  such  that  An+-jCAn.  Step  4 
would  then  be  modified  to  use  A  +^CAp  as  the  stopping  rule.  We  remark  that  the 
algorithm  viewed  in  this  manner  guarantees  convergence  in  one  iteration  if  Ag  is 
chosen  to  equal  A  since  A-jcAg  for  any  A^ .  Of  course,  the  computational  imprac- 
ticality  of  this  choice  of  Ag  limits  its  usefulness.  We  now  verify  that  the 
above  algorithm  converges  to  the  proper  subset  of  A  and  that  this  convergence  is 
achieved  in  a  finite  number  of  steps. 

PROPOSITION  3:  The  policy  iteration  algorithm  converges  to  the  fixed  point  of  H 
in  a  finite  number  of  iterations. 


INSERT  A: 


The  following  result  provides  an  important  characterization  of  the  fixed 
point  of  H  that  serves  to  motivate  the  algorithm  presented  below  for 
determining  this  fixed  point. 

PROPOSITION  2:  The  fixed  point  of  H,  f,  is  piecewise  affine  and  convex 
and  is  given  by 

f(i,p)  =  max  f. (i ,p) 

AeA  A 

for  all  ieS  and  pep. 

Proof:  The  veracity  of  the  Proposition  follows  directly  from  the  following 
well-known  (e.g.,  Bertsekas,  1976)  and  easily  shown  result:  for  fixed 
peP,  if  AeA  is  such  that  f.(*,p)  >_  f  (*,p)  for  all  ae  A,  then  f  ( -  ,p )  = 

AO  A 

[Hf XJ( * , p ) .  P—J 

We  remark  that  the  piecewise  affine  and  convex  nature  of  f  allows  us 
to  avoid  issues  related  to  the  concept  of  finite  transcience  found  in 
Sondik  (1978). 

Proposition  2  suggests  that  an  appropriate  procedure  for  calculating 
f  is  to  determine  a  set  a'SLa,  containing  as  small  a  number  of  parameter 
independent  policies  as  possible,  such  that 

f(i  ,p)  =  max  f.(i,p) 

XeA'  A 

for  all  ieS  and  p eP.  The  intent  of  the  following  policy  iteration 
algorithm  is  to  accomplish  this  objective: 


INSERT  B: 


We  also  remark  that  a.,  can  be  determined  from  6*eA,  where  Hr+7  =  Hf  , 

n+i  6*  n  n 

as  follows:  AeA  +i  if  and  only  if  6  (*,p)  =  x(*)  for  some  peP.  The 

★ 

parameter  dependent  policy  6  can  be  determined  in  a  manner  analogous  to 

★ 

the  procedure  for  determining  <5^  presented  in  Section  2. 


Proof  of  this  result  follows  the  proof  of  two  lemmas.  The  first  lemma 
indicates  that  the  stopping  rule,  An+^=An,  is  a  valid  one.  The  second  lemma 
guarantees  that  if  ^n+i^n>  then  A n+-j  produces  a  strictly  better  policy  than  does  A~ 

LEMMA  2  :  If  An+1=An,  then  ?n  is  the  fixed  point  of  H.  ; 

INSERT  C 

Proof:  Since  An+-|=An,  it  is  sufficient  to  confine  our  interest  in  policies  that  are 

members  of  A  to  those  in  A.  Assume  XeA  ,  and  let  peP  be  such  that  f. (*,p)> 

n  n  a 

f0(*,p),  for  all  oeAn.  We  contend  that  [H^]^ ,p)>jHa7n] (^.p),  for  all  oeAn.  To 

show  this,  assume  oe A  is  such  that  [H  f_](* ,p)>[H.f  ](•  ,p) ,  where  the  inequality 

n  d  n  An 

is  strict  for  at  least  one  ieS.  There  are  two  cases: 


CD  f^-.P^C’p) 

(id  y-,p)=faKp). 


Case  (i).  Define  Hk+1=H,Hk,  fk=Hkf  ,  and  fk=Hkf  .  The  isotonicity  and  con-  . 

666000  X  X  n 

k  k 

traction  properties  of  H.  for  any  6eA  imply  that  in  the  limit,  f  and  f 

O  u  A 

ronve^ge  to  f  and  f. ,  respectively,  and  that  f  (*,p)>f  (*,pl,  which  is  a  contra-  r 

0  A  0  —  A 

diction. 

Case  (ii).  Note  that  fa(*,p)=[Hofa](‘,p)=[Ho?n](*,p)>[Hxfn](*,p)= 
[Hxfx](*,p)=fx(*,p),  where  by  assumption  the  inequality  is  strict  for  at  least  one  - 
ieS.  Thus,  f  ( •  »p)>f,  (* >p)  and  f  (•  ,p)^f  (*,p),  which  is  a  contradiction.  P] 


LEMMA  3.  If  An+]Mn,  then  f„+1>fn, 


Proof:  It  follows  from  Step  3  of  the  algorithm  that  if  An+1^A  ,  then  Hf  n>Jn , 
Hfn?sfn.  Define  6eA  to  be  such  that  Hif„=Hf„.  Note  that  5  is  comprised  of  X's 


INSERT  C: 


Proof:  The  proof  of  Lemma  1  and  the  assumption  An+^  =  An  guarantee  that 
for  fixed  p,  if  AeA  is  such  that  f  (-,P)  >_  f  (*,p)  for  all  oeAn,  then 
=  [Hfx](*,p)  =  [H  f  ](.iP).  Proof  of  Lemma  2  then  follows  from 
the  fact  that  this  result  holds  for  all  p tP  and  from  the  definition  of  f 


By  the  isotonicity  of  H6, 

in  An+r  a  for  all  k  >  1 ,  H*?^;  thus,  f^fn>  where  f 

fixed  point  of  Hg.  It  is  easy  to  show  that  f  =f  whenever  6=x,  XeAn+1. 
7n+1(t,p)=maxxfx(i,P),  XeAn+1;  thus,  ?n+1>f6. 


6  is  the 
However, 

□ 


We  remark  that  the  algorithm  always  produces  a  value  function,  the  f  ,  and  an 
optimal  value  function,  the  final  7  ,  that  are  piecewise  affine  and  convex,  thus 
allowing  us  to  avoid  having  to  deal  with  issues  related  to  the  concept  of  finite 
transience  found  in  Sondik  (1978). 


Proof  of  Proposition  3:  Since  A  is  finite,  it  has  only  a  finite  number  of  subsets 
which  car.  be  examined.  Ea:h  of  these  subsets  can  te  examined  at  most  one?  sirce: 


1.  if  An+i=An>  the  algorithm  stops  (by  Lemma  2), 

2.  if  An+i^An,  then  7n+1£F  ,  fn+1^fn  (by  Lemma  3),  insuring  that  Ap  will  not 

be  considered  further.  | — | 

independent 

The  algorithm  determines  the  set  of  all  parameter  A  policies  that  may 

be  ootimal ,  given  P.  It  may  be  useful  to  be  able  to  identify  those  regions  in  P 

independent 

where  these  parameter  *  policies  are  optimal.  For  example,  if  further 

assessment  information  becomes  available  which  indicates  that  the  parameter  of 

interest  is  now  known  to  be  in  the  set  P*  C  P,  it  may  be  desirable  to  know  if  any 

independent 

of  the  nonexcluded  parameter  a  policies  can  be  eliminated.  It  is  easily 

,  .  independent 

shown  that  if  An  is  the  nonexcluded  subset  of  parameter  A  policies,  then 

the  optimal  parameter  dependent  policy  6*is  such  that  for  XeAp,  <5*(i,p)  =  x(i),  for 

all  ieS,  for  all  peP  such  that  f  (*,p)  >  f  (*,p),  for  any  aeA  . 

a  o  n 


EXAMPLE  3.  Consider  again  the  maintenance  model  examined  in  Example  2,  assuming 
the  planning  horizon  is  infinite,  the  criterion  is  the  expected  total  discounted 


reward,  and  the  discount  factor  is  0.9.  Standard  results  (Bertsekas,  1976) 
indicate  that  is  is  sufficient  to  examine  only  strategies  that  are  stage  in 
variant.  INSERT  D 


x1(l)=x2(l)=x3(l)=l 
X1(2)=X2(2)=X3{2)=1 
X1(4)=X2(4)=X3(4)=3 
X1(3)=l,  X2(3)=2,  X3(3)=3. 


The  functions  f  ,  i=l,2,3,  are  given  in  Table  3.  It  is  easily  shown  that 
xi 

f  >f  on  Sxp;  therefore,  AQ  can  be  reduced  to  the  set  {x^.x^J •  For  the  set 
3 

of  all  peP  such  that  f.  (-,p)>f,  (*,p),  [H,  f.  ](-,p)=[Hf.  ](•  ,p).  An  equivalent 


x2'  ,h,-x3 


x2  x2 


result  holds  for  all  peP  such  that  fx  (-.p)^  ( * »P ) -  Thus,  A-|-Ao’  and  the  a1“ 

3  2 

o  3 

gorithm  can  stop.  The  regions  of  P  where  >  and  X  are  optimal  are  presented  in 


2  3 

Figure  2  and  are  associated  with  the  statement:  X  (X  )  is  optimal  if  and  only  if 


INSERT  D 


Let  aq  *  {X1},  where  X^l)  =  1,  x*(2)  =  1,  x1(3)  =  1,  and  xX(4)  =  3.  The 

★ 

function  f^l  is  given  in  Table  3.  Let  6  eA  achieve  the  maximum  in  Hfxi.  It  is 

*  *  ★ 

easily  shown  that  5  (l,p)  =  6  (2,p)  =  1  and  6  (4,p)  =  3  for  all  peP.  Straight¬ 
forward  calculations  show  that 


h(3,p,l,f  l)  »  -13.1968  +  1.96821 p£ 
h(3,p,2,M)  =  -10.13630  +  +  1.36260p2 


h(3,p,3,f.l)  =  -9.12945  +  2.2944p? 


indicating  for  peP, 


6  (3,p)  ■  2  if  p  -  0.9684p2  >  1, 


00685 


Thus,  A-j  = 


=  3  otherwise, 
(x  ,x  }  f  Aq,  where 

X2(l)  =  x3(l)  =  1 
x2(2)  =  X3(2)  =  1 


X2(4)  =  X3(4)  =  3 


*(3)  =  2  ,  3(3)  =  3. 


The  resulting  functions  f^2  and  f^3  are  also  given  in  Table  3.  Further 
calculations  indicate  that  A2  =  h  ,  and  hence  the  algorithm  can  stop. 


4-5a 


Iml 


V  MAXIMIN  POLICIES 

In  earlier  sections,  we  have  concentrated  on  determining  the  set  of  all 

independent  .  .  „  „  ,  , 

parameter  A  strategies  that  are  optimal  for  some  value  of  the  imprecise 

parameter.  If  further  parameter  value  assessment  can  eliminate  all  but  one  of 
these  strategies,  then  strategy  selection  is  trivial.  If,  however,  such  elimi¬ 
nation  is  not  possible,  we  are  still  confronted  with  the  problem  of  which 
independent 

parameter  *  strategy  to  choose.  A  likely  candidate,  and  the  candidate 

independent 

of  interest  In  this  section,  is  the  parameter  A  strategy  that  maximizes, 
with  respect  to  all  other  strategies,  the  minimum  value  of  its  expected  reward 

function,  where  the  minimum  is  taken  over  all  possible  parameter  values.  That 

<\/ 

is,  for  the  infinite  horizon  case,  we  seek  a  XeA  such  that 

inf  Mi,p)>inf  f  (1,p) 

X  x 

peP  peP 

'V 

for  all  ieS  and  XeA.  We  remark  that  such  a  X  may  not  be  a  member  of  the  set  of 
independent 

ail  parameter  strategies  that  are  optimal  for  some  value  of  the  imprecise 

parameter.  The  infinite  horizon  problem  defined  in  Section  4  represents  the 
problem  of  interest;  therefore,  we  will  assume  assumptions  A1 ,  A2,  and  A4  hold 
throughout.  Extension  of  the  results  to  be  presented  to  the  finite  horizon  case 

C 

is  straightforward  and  left  to  the  reader.  Let  ||  *||  :  Hr-*- -R  be  defined  as  ||  v||  = 
suPjIVjl,  where  v={v..}.  Define  h^th1  [i  ,X(i)],ieS},h2={h2  [i  ,X(i  )]n#ieS,n=l . . .  ,N}, 
and  h^={h  [i ,X(i )]  •  ,i , jeS}.  We  now  present  our  first  result  of  this  section. 

A  J 


PROPOSITION  3:  Assume  that  XeA  is  such  that  for  each  XeA,  f?(i ,p)>f, (i ,p)  for 


r\j  M 

all  ieS  for  some  pe  IR  .  Then,  for  each  XeA, 


inf  f/Ji.p)  +  oinf  f .  ( i  ,p) 
X  -  A 

peP  peP 


for  all  ieS,  where: 

•  e  =  max  sup  ex(p,p)  , 

/V 

XeA  peP 

a. 

•  P  is  the  set  of  all  possible  points  in  the  closure  of 
P,P,  that  can  achieve  the  infinium  in  inf{fx(i,p),peP} 
for  any  ieS  and  XeA, 


+  ||  (i-hj)"^!!  IIp-p'H. 


Proof:  Note  that  since 

fx(*,p)  *  (I-h^)'1[hx+hxp], 

the  following  relationships  hold: 


f%(’.p)  -  f,(*,p') 


m 


=  [f^(*.p)-f%(*,p)]  +  (*,p)]  +  [f  (*»p)-f  (•  »p* )3 

A  A  A  A  A  A 


>  [^(•>p)-^(*,p)]  +  [fx(-,^)-fx(*,p')] 

•  (I-h^^h^p-p)  +  (I-h3)"1h2(^.p’ ). 
XX  XX 


Thus, 


f^(i,p)  +  ex(p,p')^fA(i,p') 

X 

for  all  ieS.  The  result  then  follows  directly. 


Proposition  3  indicates  that  we  should  locate  p,  which  may  or  may  not  be  a 
member  of  P,  as  close  to  all  elements  in  P  as  possible.  We  now  present  a  condition 

f\,  ^ 

that  implies  that  P  is  a  singleton,  guaranteeing  that  p  can  be  chosen  in  P  and 
that  e=0. 


A5.  There  is  a  peP  such  that 

h2 ( i ,a)p  s  inf  h2(i ,a)p 
peP 

for  all  ieS  and  acA(i ). 


S  / 


COROLLARY.  Assume  peP  satisfies  A5  and  that  XeA  is  such  that  for  each 

XeA,f%(i »p)>f,  (i ,p)  for  all  ieS.  The  ,,  for  each  XeA, 

X  A 


inf  f^(i,p)>inf  f.(i,p) 
X  A 

peP  peP 


for  all  ieS. 


Proof:  It  follows  from  Proposition  3  that  it  is  sufficient  to  show  that  A5 


implies  f,(i,p)  =  inf{f. (i ,p) ,peP},for  all  ieS,  for  any  XeA.  Clearly, 


1nf{fx(1.p).peP}<fx(1.P),  f°r  all  ieS.  In  order  to  show  that  f^(i,p)£inf{f^(i,p), 
peP),  for  all  ieS,  define  f^(1,p)=0  and  f^(i ,p)=h[i ,p,X(i ) ,f"-1 ]  for  all  i  and  p. 
Trivially,  inf{f°(i,p),peP}=f°(i,$)  for  all  i;  assume  inf{f"_1 (i ,p) ,peP}= 


f”  ^(i>$)  for  all  i.  It  is  then  easily  shown  that  inf{f"(i ,p) ,peP}=f"(i ,#)  for 


all  i,  which  by  induction  holds  for  all  n.  Thus,  f^(i  ,p)_<f^(i  ,p)  for  all  i  and 


for  any  peP  ,  which  implies  f^(i  ,p)<inf{fx(i  ,p) ,peP}  for  all  i. 

We  remark  that  although  A5  appears  to  be  a  strong  assumption,  there  are 
interesting  problem  formulations  that  satisfy  it.  For  example,  consider  the  case 


2  / . 


where  h  (i,a)n=l  if  i=n(=0  if  i^n),  pne[LBn,UBn],n=l ,• • • ,N}eP.  Then,  we  would 


select  INSERT  E  As  another  example,  observe  that  in  Example  3,  £=(-6,-7) 

satisfies  A5  and  hence  by  the  Corollary, 


inf  f.  (i,p)>inf  f,(i,p) 


peP 


peP 


for  all  ieS  and  XeA. 


INSERT  E 


«.  T 

p={LB1 . . *LBn>  ,  where  T 


I 


=  transpose 
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f2(i,p)  =  0  for  all  ie$,  pep 

I 


E 

V1.P) 

»  0,  i 

sf(l.p)  «  1 

1 

f-,  C2,pJ 

=  -1, 

6fC2.pl  =  1 

>_ 

V3.pl 

=  max 

{“3 ,0. } >  6* (3 , 

1 

o)  1 

'l  if  -3  >  P] 
2  if  >_  -3 

!  (4,p) 

p2  * 

6f(4,p)  =  3 

i 

f0O.p) 

=  max 

{C-17+p2)/16, 

(-14+Pl+p^)/16}, 

6jd.pl  =  1 

f0(2,p) 

*  max 

{(-17+p2)/8  , 

(-14+p^+p2V8>  , 

6j(2.P)  «  1 

K 

f0(3,p) 

=  max 

{-1+Pi .  p2> , 

6q(3 ,p)  =[2  if  - 

1+P-|  >  p2 

'* 

(^3  if  c 

>2  >  -1+p-j 

f0(4,o) 

=  p2, 

«5(4,p)  -  3 

> 


) 


► 

TABLE  2:  Optimal  Expected  Utility  Functions  and 

Possibly  Optimal  Strategies  for  Example  2. 
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VI  CONCLUSIONS 

In  this  paper,  we  considered  a  specially  structured  class  of  finite  state, 
finite  action  dynamic  programs  having  an  imprecisely  described  parameter.  It 
was  assumed  that  the  parameter  has  no  dynamics,  no  new  information  about  its 
value  is  received  once  the  problem  begins,  and  its  imprecision  is  described  by 
set  inclusion.  We  developed  computational  procedures  for  determining  the  set 
of  all  strategies  that  may  be  optimal,  given  a  description  of  the  parameter's 
imprecision.  Applications  to  decision  analysis  and  Markov  decision  processes 
were  presented.  A  condition  was  also  presented  which  guaranteed  that  a  parameter 
independent  strategy  maximizes,  with  respect  to  all  other  parameter  independent 
strategies,  the  minimum  value  c*  its  expected  reward  functior,  where  the  minimum 
is  taxen  over  all  possible  parameter  values.  Consideration  of  different  functional 
forms  of  the  one  transition  value  function  and  different  assumptions  regarding  the 
dynamics  and  timing  of  information  availability  regarding  the  unknown  parameter 
are  topics  for  future  study.  Two  other  topics  for  future  study  are  1)  an  analysis 
of  the  computational  feasibility  of  the  algorithms  presented  in  Sections  2  and  4 
(related  discussions  can  be  found  in  Smallwood  and  Sondik,  1973,  and  Sondik,  1978) 
and  ?.)  the  development  of  parametric  programming  and  successive  approximation 
procedures  for  the  infinite  horizon  cas>»  and  their  comparison  to  the  policy  iteration 
algorithm  presented  in  Section  4. 
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1.69651 

p2 

-5.34402 

0 

2.45052 

-  - 

-5.34402 
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— 
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TABLE  3:  Expected  Total  Discounted  Reward  Functions 
\  for  Example  3. 
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ABSTRACT: 

We  present  a  model  of  sequential  decisionmaking  under 
uncertain  future  preferences.  The  evolution  of  the  tradeoff 
weight  vector  is  constrained  by  set  inclusion.  Three  different 
me ch?".is ms  are  considered  for  selectirg  the  next  tradeoff 
weight  vector:  a  mechanism  working  against  the  DM  (M),  a 
mechanism  trying  to  aid  the  DM  (B),  and  (briefly)  a  probabilistic 
mechanism  (P).  Piecewise  linear,  convex  upper  and  lower 
bounds  on  the  optimal  value  function  are  determined  for 
mechanisms  M  and  B.  Conditions  are  given  which  guarantee  that 
the  optimal  value  function  is  piecewise  linear  and  convex  for 
all  three  mechanisms.  Procedures  for  computing  these  bounds 
and  determining  associated  strategies  are  presented.  A 
hypothetical  situation  involving  an  individual  seeking 
promotion  is  used  to  illustrate  the  model  and  the  numerical 
techniques. 
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In  the  usual  development  of  normative  decision  theories  and  descriptions 
of  decisionmaking,  no  provision  is  made  that  preferences  may  change  over  the 
planning  horizon.  Examples  of  normative,  quantitative  models  of  multi - 
objective,  sequential  decisionmaking  with  fixed  preference  structures  can  be 
found  in  Henig  (1978),  Mitten  (1975),  Sobel  (1975),  Viswanathan,  et.al. 

(1977),  and  White  and  Kim  (1980).  In  practice,  a  decisionmaker  may  reject 
an  optimal  solution  determined  on  the  assumption  that  initial  preference  is 
absolute  and  permanent  and  accept  a  solution  which  offers  more  flexibility  for 
later  adjustment.  Such  choice  behavior  would  reflect  a  recognition  that 
preferences  may  change  and  that  so-called  "optimal"  solutions  can  lead  to 
commitments  that  will  be  judged  harshly  in  the  future.  In  fact,  empirical 
evidence  exists  which  suggests  that  ignoring  the  ambiguities  due  to  changing 
preferences  may  lead  both  to  misinterpreting  choice  behavior  and  to 
incorrectly  modeling  the  normative  decisionmaking  problem  (see  March  (1978), 
p.  590,  and  related  references  cited  by  March). 

Several  different  models  of  changing  preferences  have  been  proposed. 

Cyert  and  DeGroot  (1975)  have  proposed  that  the  utility  function  be  viewed 
as  a  function  of  imprecisely  known  static  parameter  values,  the  estimates  of 
which  change  as  a  result  of  learning  through  experiencing  noise  corrupted 
observations  of  the  true  parameter  values.  Learning  is  assumed  to  occur 
according  to  a  Bayesian  update,  requiring  a  prior  distribution  and  a 
probabilistic  description  of  the  relationship  between  outcome  and  underlying 
parameter  values.  Thus,  the  actual  utility  function  does  not  change; 
however,  the  perceived  utility  function,  the  utility  function  on  which  the 


decisionmaker  selects  alternatives,  does  change  as  a  function  of  experience 
and  hence  stage  or  decision  epoch. 

Witsenhausen  (1974)  has  suggested  a  suboptimal  design  procedure  which 
he  calls  the  assumed  permanence. procedure.  This  suboptimal  design  is 
determined  as  follows.  Determine  current  preferences,  and  select  the  best 
action  for  the  current  stage,  assuming  current  preferences  will  remain  in 
effect  over  the  remainder  of  the  problem  horizon.  At  the  next  stage,  reassess 
preferences  and  select  the  best  action  for  that  stage,  assuming  that  the 
reassessed  preferences  will  remain  in  effect  over  the  remainder  of  the 
rrcblem  horizon,  and  so  forth.  Witsenhausen  notes  that  an  optimal  design 
could  be  determined  if  a  stochastic  model  of  preference  evolution  were 
available. 

Kreps  (1977,  1975)  enlarged  the  notion  of  a  state  in  a  Markov  decision 
process  with  utility  criterion  to  include  a  so-called  summary  descriptor. 

The  summary  descriptor  can  be  used  to  model  changes  in  preference,  level  of 
aspiration  or  expecta  ,cy,  etc.  Bodily  and  White  (1982)  used  this  notion  to 
model  an  investor's  evolving  attitude  toward  levels  of  consumption,  as  a  functi 
of  current  and  past  levels  of  wealth,  thus  modeling  the  change  of  preferences 
between  consuming' and  investing  over  time.  Related  results  are  presented  in 
Meyer  (1977). 


In  this  paper,  we  consider  a  finite  stage  decision  analysis  problem  haying 
a  decision  tree  with  no  chance  nodes  (no  probabilistic  description  of  uncer¬ 
tainty),  We  explicitly  allow  a  description  of  preference,  a  vector  of  tradeoff 
weights,  to  change  from  stage  to  stage.  We  assume  the  next  tradeoff  weight 
vector,  constrained  to  be  a  member  of  a  set,  is  either  (1)  selected  by  a 
mechanism  working  against  the  decisionmaker,  (2)  selected  by  a  mechanism 
trying  to  aid  the  decisionmaker,  or  (3)  selected  probabilistically.  Emphasis 
is  placed  on  the  former  two  types  of  dynamics  since  (1)  we  feel  that  their 
relative  simplicity  should  enhance  assessment  of  the  tradeoff  weight  dynamical 
description  and  (2)  the  dynamics  of  variables  that  can  affect  preference  may 
not  be  adequately  described  probabilistically,  e.g.  political,  behavioral,  and 
organizational  issues.  The  set 


inclusion  description  of  dynamics  has  been  examined  by  Cherene  (1978)  in  an 
economic  context  and  by  Bertsekas  and  Rhodes  (1973)  in  a  general  control 
context.  A  related  study  can  be  found  in  Fiqueras  (1972). 

At  first  glance,  the  problem  to  be  dealt  with  in  this  paper  and  the 
iterative  procedures  for  solving  multiple  criteria  problems  (see,  for  example, 
Zionts  and  Wallenius  (1976),  Geoffrion,  et.al.  (1972),  and  Musselman  and 
Talavage  (1980))  seem  closely  related.  They  differ,  however,  in  the  following 
fundamental  way.  The  procedures  for  solving  multiple  criteria  problems 
iteratively  collect  new  information  to  more  accurately  describe  a  static 
description  of  preference  (as  is  true  in  the  work  by  Cyert  and  DeGroot  (1975)), 
whereas  the  problem  to  be  considered  here  assumes  that  the  DM  knows  exactly 
the  current  description  of  preference  but  that  the  description  of  preference 
is  allowed  to  evolve  dynamically. 

The  paper  is  outlined  as  follows.  Two  models  of  decisionmaking  are 
presented  in  Section  2.  Both  models  assume  that  preference  evolution  is 
described  by  set  inclusion  and  that  the  decisionmaker  bases  the  current 
alternative  selection  on  exact  knowledge  of  the  current  tradeoff  weights. 

The  models  differ  in  how  the  next  set  of  tradeoff  weights  are  chosen.  The 
first  model,  the  maxi min  problem,  assumes  the  next  set  of  tradeoff  weights  are 
selected  so  as  to  reduce  total  value  as  much  as  possible.  The  second  model, 
the  maximax  problem,  assumes  selection  is  intended  to  increase  total  value 
as  much  as  possible. 

Dynamic  programs  and  sufficient  conditions  for  optimality  for  both  the 
maximin  and  maximax  problems  are  presented  in  Section  3,  and  various 
preliminary  results  can  be  found  in  Section  4. 


The  maxi  min  problem  is  studied  in  Section  5.  We  determine  a  piecewise 
linear,  convex  lower  bound  on  the  optimal  value  function.  This  bound  is 
shown  to  be  exact  when  two  objectives  are  being  considered.  The  desirable 
feature  of  this  functional  form. is  that  it  leads  to  a  simple  procedure  for 
computing  the  lower  bound  and  a  suboptimal  design,  which  we  also  present. 

In  Section  6,  a  piecewise  linear  and  convex  upper  bound  is  determined 
on  the  optimal  value  function  for  the  maximax  problem;  a  procedure  for 
computing  this  bound  and  its  associated  design  is  presented. 

Piecewise  linear,  convex  upper  and  lower  bounds  are  determined  in 
Ce:tion  7  on  tl.e  optimal  value  function  for  the  niaximin  and  maximax 
problems,  respectively.  Again,  a  procedure  for  computing  these  bounds  and 
their  associated  designs  is  presented. 

For  completeness,  a  different  perspective  is  taken  in  Section  8. 

Emphasis  is  placed  on  tractability  rather  than  on  the  development  of 
models  that  are  intended  to  have  dynamics  which  are  relatively  easy  to 
assess.  We  assume  that  the  number  of  tradeoff  weight  vectors  that  might 
possibly  occur  at  tne  next  stage  is  finite  and  that  each  of  the  possible 
future  tradeoff  weight  vectors  h's  nonnegative  elements  and  satisfies  the  sum 
to-one  property.  We  then  show  that  the  previously  determined  upper  bound 
for  the  maximax  problem  is  exact.  Under  the  assumption  that  the  next  trade¬ 
off  weight  vector  is  selected  probabilistically,  we  show  the  problem  becomes 
equivalent  to  a  partially  observed  Markov  decision  process,  a  solution 
procedure  for  which  is  presented  in  Smallwood  and  Sondik  (1973).  We  remark 
that  this  solution  procedure  is  based  on  the  fact  that  the  optimal  expected 
value  function  is  piecewise  linear  and  convex  and  has  provided  insight 
into  the  development  of  all  of  the  aforementioned  computational  procedures. 


Suboptimal  design  procedures  are  discussed  in  Section  9.  A  hypothetical 
example  with  numerical  results  is  presented  in  Section  10.  Conclusions  are 
presented  in  Section  11.  Proofs  of  all  results  are  contained  in  the  Appendix. 


’  PROBLEM  FORMULATIONS: 

k 

Assume  that  the  decisionmaker  (DM)  must  select  an  alternative  a  from  a 

v 

finite  set  of  alternatives  A  at  each  stage  k=0,l , . . . ,K-1 ,  We  further  assume 

that  the  associated  decision  tree  contains  no  chance  nodes;  therefore,  the 

0  k-1 

collection  of  alternatives  a  ,...,a  uniquely  identifies  a  stage  k  decision 

k  0  k 

node  and  for  the  case  where  k=K,  identifies  a  terminal  node.  Let  (a  .... ,a  ) 

be  the  value  received  at  stage  k  with  regard  to  objective  n  if  a^  was  the 

alternative  selected  at  stage  £=0,1 . . , k-1  and  if  a^  is  selected  at  stage  k, 

k<K.  Let  pk(a°, . . . ,ak-^ )  be  the  terminal  value  received  at  stage  K  with 

regard  to  objective  n  if  a£  was  the  alternative  selected  at  stage  £, 

£=0,1 . .  ,K-1 .  Define  pk(a°, . . .  ,ak)  =  col{pk(a0,. . . ,ak)},  for  k<K,  and 

pK(a0,. . . ,aK_1)  =  col{pK(a°,...,aK"1)}. 

n 

The  DM's  impression  of  the  importance  of  objective  n  at  stage  k 
relative  to  the  available  alternatives  is  expressed  by  the  real  number 
which  we  will  refer  to  as  the  tradeoff  weight  of  objective  n  at  stage  k. 

We  assume  that  nk  =  row{r,^}eN  =  {qe  R^:nn>0,n=l , . . .  ,N,£  N-,n=l}.  The  value 
accrued  at  stage  k<K  is  assumed  to  be  represented  by  the  inner  product 
qkpk(a°,. ..  ,ak)  =  ik  pk(a°, . . . ,ak}  if  the  DM's  tradeoff  weight  vector  is 
nk  and  if  a^  was  the  alternative  selected  at  stage  £=0,1,..., k.  Similarly. 
qKpK(a0,. . .  ,aK"^ )  is  the  accrued  terminal  value.  The  total 

discounted  value  accrued  by  the  alternatives  a0 . aK'^  and  the  tradeoff 

K-1 

weight  vectors  q°,...,qKis  assumed  tc  be  ^6*Sikpk(a°, . . .  .a^+s^qKp^a0, •  •  • , 
ak-l)  where  £k  is  the  discount  factor  B  raised  to  the  k^  power.  Presumably, 
0<S<1;  however,  the  analysis  will  only  require  6>0. 
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We  justify  choice  of  the  above  criterion  as  follows.  The  criterion  clearly 

generalizes  the  additive  value  function  under  the  (usual)  assumption  that  the 

tradeoff  weight  vector  is  static  and  known  before  alternative  selection  begins. 

/is 

Note  that  under  this  assumption,  it  sufficient  to  set  6=1  and  pk=0  for  all 
k=0,..,,K-l,  Furthermore,  value  is  allowed  to  accrue  on  the  basis  of  descrip¬ 
tions  of  preference  at  any  stage  in  the  planning  horizon.  We  have  assumed  that 
the  criterion  is  temporally  additive  for  technical  reasons;  we  will  see  that  the 
associated  dynamic  programs  permit  the  development  of  relatively  tractable  com¬ 
putational  procedures.  Related  discussions  involving  von  Neumann  Morgenstern 
utility  functions  that  allow  experiential  adaptation  of  preferences  can  be  found 
ir  Meyer  (1977' . 

We  assume  that  the  DM' s  preferences,  as  modeled  by  the  tradeoff  vector, 

may  change  from  stage  to  stage.  Thus,  {nk,k=0,l . K}  is  a  process,  the 

dynamics  of  which  may  depend  on-,  say,  its  past  history,  all  former  alternatives 
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selected,  and  a  variety  of  other  processes  that  have  uncertain  dynamics. 

For  example,  our  future  tradeoff  weight  for  gas  milage  might  reasonably 
depend  on  our  history  of  automobile  purchases,  our  current  and  perhaps  our 
past  tradeoff  weights  for  gas  milage,  and  processes  such  as  the  future  cost 
of  gas,  future  attitudes  of  the  car-buying  public,  and  so  forth.  Such  a 
perception  suggests  that  the  next  tradeoff  vector  may  be  described  by  a 
stochastic  difference  equation  dependent  on  past  and  present  tradeoff 
vectors,  alternatives,  and  exogenous  variables.  The  dynamics  of  the 
exogenous  variables  may  also  be  appropriately  described  by  stochastic 
difference  eqjat'fons.  Wo  envision,  however,  that  a  description  of  what 
value  the  tradeoff  vector  may  next  assume  will  be  assessed  from  the  DM,  and 
hence  we  view  simplicity  to  be  an  important  characteristic  in  any  descrip¬ 
tion  of  preference  dynamics.  A‘ particularly  simple  description  of  state 
dynamics  is  set  inclusion.  Such  a  description  requires  less  information 
than  a  probabilistic  description.  Furthermore,  our  model  will  not 
explicitly  consider  the  impact  of  various  exogenous  variables  on  preference. 


eliminating  a  need,  for  oetxer  or  for  worse,  to  mooe!  such  variables.  More  precisely 
assume  that  0,  .  ..  .. 

Athere  is  a  function  MK:NxAx. .  .xAK-*-2N(2N  represents  the  power  set  of  W,  the 
set  of  all  subsets  of  N),k=0,l,...,K-l,  such  that  nk+1oMk(nk,a°» ■ • • .ak) • 

Thus,  nk+1  is  constrained  to  be  a  member  of  a  set  in  W  which  can  depend  on 
nk,a°,..,ak.  We  will  assume  throughout  that  Mk(nk,a°, . . . ,ak)r4>  for  all 
nkcW,a£eA£,£=0,. . . ,k,  and  k=0,...,K-l. 

The  actual  mechanism  that  selects  from  Mk(nk,a0,. . .  .a^)  is  com¬ 


plex,  as  we  have  indicated,  and  may  be  related  to  and  to  some  degree 
controlled  by  the  DM.  The  two  mechanisms  that  we  will  primarily  consider 
here,  referred  to  as  "Nature",  are: 


1.  nk+^  is  chosen  to  reduce  total  discounted  value  as  much  as  possible 
(mechanism  M,  associated  with  a  malevolent  Nature). 

2.  is  chosen  to  increase  total  discounted  value  as  much  as  possible 
(mechanism  B,  associated  with  a  benevolent  Nature). 

(A  probabilistic  mechanism  for  selecting  nk+^ ,  mechanism  P,  will  also  be 

briefly  discussed  in  Section  8.)  No  attempt  will  be  made  to  justify  the 

(possibly  dubious)  claim  that  these  two  mechanisms  are  accurate  models  of  future 

tradeoff  weight  selection;  their  use  is  intended  only  to  help  provide  bounds  on  the 

total  value  to  be  accrued  and  systematic  approaches  for  alternative 

selection. 

The  desired  goal  of  the  OM  is  to  select  alternatives  so  as  to  maximize 
the  total  discounted  value.  In  so  doing,  we  assume  that  the  DM  knows  (or  assumes) 
the  following  over  the  entire  planning  horizon: 

(i)  the  criterion  structure,  K,  8,  the  sets  Ak  and  Mk,  k=0,...,K-l, 
the  appropriate  probabilities,  if  required,  and  the  functions 
p  ,k=0 . K, 

( i i )  the  type  of  mechanism  (either  M,  B,  or  P)  that  selects  nk+1 
from  Mk(nk,a°, . . . ,ak) ,k=0, . . . ,K-1 . 

(iii)  that  nk  and  a°,...,ak"^  will  be  made  available  to  the  DM  before 
ak  must  be  selected,  for  all  k=0,l.. . . .  ,K-1 . 

Note  that  (iii)  implies  that  the  DM  has  (a)  the  current  value  of  the  trade¬ 
off  vector  and  the  current  alternative  history  on  which  to  base  the  current 
■alternative  selection  and  (b)  knowledge  that  such  information  will  be  made 
available  to  him  accordingly  in  the  future.  Suppressing  (i)  and  (ii)  for 
notational  brevity,  we,  therefore,  define  a  policy  at  stage  k  as  a  function 
6k:NxAx. .  .xAk“^-*-Ak.  A  strategy  is  a  collection  of  such  policies;  i.e.,  tt  = 

(6° . }. 


The  total  value  accrued  by  policy  it,  given  initial  trade-off  weight 
vector  n°»  is: 


Z  (n°)  ■  extjl  BknkPk(a°,...,ak)  +  BKnKPK(a°,...,aK_1)/ , 

(k=0  ] 

where  a^  =  fi'<(nk,a0,. . .  .a^"^ )  and  where  extrema  are  with  respect  to 
n1,....nK,  subject  to  the  constraints  nk+^eM*<(rik>a0,. . .  ,a'<),k=0,...,K-l. 

For  the  case  where  selection  mechanism  M  is  in  effect,  the  extrema  are  infima 
and  we  designate  =  Z^;  when  the  selection  mechanism  is  B,  then  the  extrema 
are  supreme,  ar.d  we  designate  -  Z^.  Explicit  definitio.i  of  the  criterion 
for  mechanism  P  will  be  stated  in  Section  8.  We  wish  to  determine  a  strategy 
it*  such  that  Z-nicZZ-n  for  71  •  Such  a  strategy  will  be  called  a  maxi  min 

strategy  if  mechanism  M  is  assumed  and  a  maxi  max  strategy  if  mechanism  B  is 
assumed. 


fc .  • 


THE  DYNAMIC  PROGRAMMING  EQUATIONS: 


We  now  present  dynamic  programming  equations  and  sufficient  conditions 
for  optimality  for  both  the  maximin  and  maximax  problems.  Define 


,k,  k  o  k-1. 
Z*(tj  »•••»&  ) 


=  ext  l  et‘kntpt(a°,...,at)  +  eK~knKpK(a°,...,aK“1) 
t=k 


vhe-e  a*  *  . . .3**1)  frr  k<t<K-l  and  where  the  extrema  are  taken  w*th 

respect  to  nk+1 >• • • ,nK,  subject  to  the  constraints  nt+1cMt(nt.a°,. . . .a^) , 
t=k, . . . ,K-1 .  Let 


Zk(nfc,a0,...  ,ak-1)  =  sup^zj^.a0,. . .  ,ak“T)  . 


Define  for  k=0,l ... . ,K-1 , 


hk(n,a0,. . . ,ak~ ' ,a,v) 


■  npk(a0,.. . ,ak_1 ,a)  .+  Bext{v(n' ) :n' eMK(n,a0,. . . ,aK" 1 ,a)} 


i  \ .  •  ^ukr„  ao 


[H«v] 


=  hk[n,a° . ak_1 ,6(n,a°, .. . ,ak_1) ,v] 


H^y  =  sup^H*  v. 


■  ,«  «•  ^  i 


■.  ■.  *. 
s' 

.  s- 
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Then,  straightforward  arguments  (see,  for  example,  Bertsekas  (1976),  p.  65) 
imply: 

(i)  Zk  satisfies  the  dynamic  programming  equation  (DPE) 

Zk  =  Hk(Zk+1),k=K-l,...,0, 
or  more  explicitly, 

Zk(n,a° . ak_1)  =  sup  jnpk(a° . ak_1,a) 

acAk(. 

+6ext{Z,'+1  (n‘  ,a°, . . .  ,ak“1  ,a)  :n‘  cMk(n.a°, . . .  .a^1  ,a)>  j 

(ii)  the  boundary  condition  for  the  DPE  is  ZK(n,a°, . . . ,aK_1 )  = 

nKpK(a°,...,aK_1), 

(iii)  Z°  =  s’.’p^Z^, 

(iv)  if  6k  is  such  that  Zk  =  Hkk(Zk+^),  k=0,...,K-l,  then  ^={6°, . . . ) 
is  a  maximin  (maximax)  strategy  if  the  extremum  in  hk  is  an 
infimum  (supremum). 
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V 


PRELIMINARIES 


We  now  present  several  preliminary  results,  assumptions,  and  definitions 

that  will  be  of  benefit  in  constructing  computable  upper  and  lower  bounds  on 

k  k 
J  and  L\ 

Consider  the  following  assumption: 

A1 .  is  such  that  if  n'cM{n^)  and  n"cM(n2)»  then  Xn,  +  (1-X)ri"e 

M[Xn1+(l-X)n2]  for  any  Xe[0,l],  for  all  n"1  ,n2eN. 

Define  g:  bh-  R  as  g(n)  *  inf{v(n' ) :n'eM(n)}.  where  v:N-*-  R.  The  following 
result  will  be  of  importance  in  proving  the  convexity  of  0^  on  N,k=0,...,K. 
LEM/iA  1.  If  v  is  convex  ana  M  satisfies  Al,  then  g  is  convex. 

We  can  now  give  conditions  which  guarantee  that  is  convex. 
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PROPOSITION  1.  Assume  «k( • ,a°, . . . ,ak)  satisfies  A1  for  all  a£eA£,£=0,. . . ,k, 
and  k-0,...,K-l.  Then,  Jk(*,a° . ak“^)  is  convex  on  W  for  all  k=0,...,K. 

We  now  present  an  assumption  and  a  result  which  will  lead  to  the  develop¬ 
ment  of  a  piecewise  linear  and  convex  lower  bound  on  Jk  in  Section  5. 

A2.  Let  M(n)  ■  (n)’ where  M'(n)  =  CH{nQe,e=l , . . . ,E)  (CH  s  convex  hull)  and 

where  E  and  Qg,  e=l,...,E,  are  given,  Qfi  is  an  N*N  matrix  for  each  e=l,...,E 
(i)  the  rows  of  Qe  sum  to  one  for  all  ee{l,...,E}  (note  that  Qe  may 
not  be  stochastic), 

(ii)  the  matrix  Qe~Qe  ■  has  identical  rows,  for  each  e,e'e{l . »E). 

Note  that  in  order  for  M(r))j*4>  for  all  n  e  W  when  A2  holds,  there  must  exist 

at  least  one  e  for  each  n  e  N  such  that  nQe£w* 

We  remark  that  a  M'(n)  which  satisfies  A2  does  not  change  shape  or  rotate 

as  n  changes.  Two  important  implications  of  this  characteristic  are  presented 


* 


N 

LEMMA  3.  Assume  M*  satisfies  A2.  Then,  for  any  acR  ,  ext{n'a:r,'  cM'  (n)}=nQe*a,  where 
e*e{l,...,E}  is  dependent  on  a  but  is  independent  of  n  t  N. 


We  would  expect  that  a  typical,  extreme  point  of  M'(ti)  that  would  be 

assessed  from  a  DM  would  be  of  the  form  nn,=nn+cn,n<N.  Such  a  description  of 

rN-1 

an  extreme  point  allows,  for  example,  W  (n)={n' :in<nII1-nn<un,n<N,njl<!Sl-in_^n'n}. 
It  is  easy  to  show  that  if 

Qnn  =  1+cn 
^mn  =  cn 

VN-1 

QmN  "  "  in_-jcn 


,  n<N 

,  m^n,  n<N 

,  ntfN 
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then  nQ=n‘.  Let  Q1  be  defined  as  is  Q  except  replace  the  cn  by  cn'.  Then,  it 
is  easily  shown  that  A2  (ii)  holds.  We  therefore  contend  that  A2  is 
sufficiently  weak  to  allow  relevant  descriptions  of  M. 

Consider  the  following  definitions.  Let  i  :W-*-  R  be  such  that 
i(n)=sup{v(n'):n,eW(n)}  for  v:W-*  R  and  M:N->-2w.  Define 


I(A.E,Qe,n)  =  max  max  nQea- 
aeA  1  <e<E 

G(A ,  E , Qg , n)  - 

maxJ  min  maxn'a,  max  min  nQea[- 
/  n’eW  cxeA  aeA  l<e<E  j 

Note  that  if  a  function  v:^  R  is  piecewise  linear  and  convex,  there  is  a  set 
of  N-vectors  A  such  that  v(n)=max{na:as4 }.  We  now  present  a  key  result,  in  t.he 
development  of  bounds  on  both  and  L^. 

LEMMA  4.  Assume  v  is  piecewise  linear  and  convex  and  that  the  finite  set  A 
is  such  that  v(n)=roax{ria:a©\  )•  Assume  further  that  M  satisfies  A2  and  that 
r)Qe,e=1 . E,  are  the  extreme  points  of  M* (n) -  Then,  for  all  n  e  N: 

(a)  G(A,E,Qe,n)  is  piecewise  linear  and  convex  and  G(A,E,Qe»n)<g(ri) , 

(b)  for  N=2,G{A,E,QeVi)=g(n), 

(c)  I(A,E,Qe,n)  is  piecewise  linear  and  convex  and  i (n)<I(A>E,Qe,n). 


LOWER  BOUNDS  FOR  THE  MAXI MIN  PROBLEM: 


In  this  section,  we  determine  piecewise  linear,  convex  lower  bounds 
on  Jk  which  are  exact  when  N=2.  We  also  present  a  procedure  for  computing 
these  lower  bounds. 

Assume  A2  holds  for  all  Mk.  We  recursively  construct  the  function 
and  the  set  of  vectors  a£  as  follows.  Let  A^(a0,. . . ,ak-1 )  =  (pK(a0,. . . 

and  jj^(nK,a0,. . .  ,aK_1 )  =  r)K  PK(a° . aK-l).  Assume  Ak+1  (a0, . . .  ,ak)  is  known 

and  that  JLk+1  (r)k+1  ,a0,. . . ,ak)  =  max{nk+^ct-'ctcA^+1  (a0,. . . ,ak)}.  By  Lemma  4(a), 
o(<s,E,Qe,ri)  ii  piecewise  linear  and  convex  on  N.  Thus,  for  each  akeAk,k<K, 

Jk(nk,a°,...,ak)  =  nkPk(a0,. . . ,ak)  +  8G(  A,E  ,Qe,nk) 

is  piecewise  linear  and  convex  on  N,  where  te^+1(a° . ak),  E=Ek(a°, . . . ,ak) , 

and  Qe=Qg(a°, . . . ,ak) .  Define 

Jk(nk,a0,. . . ,ak-l)  =  max  jtc(nk,a° . ak) 

akeAk 

which  is  also  piecewise  linear  and  convex  on  W,  and  hence  there  is  a  set 
AlU0,.  . .  ,ak_1 )  such  that  Jk(nk,a0,. . .  ,ak‘^ )  ■  max{nka:aeAk(a°,...,ak"1)}. 
PROPOSITION  2.  Assume  Mk(* ,a°, . . . ,ak)  satisfies  A2  for  all  a^eA^.I^O,. . . ,k 


all  k 

=  0  9  •  •  •  9  K-l  • 

Then, 

(a) 

Jk(* »a0,.. . 

,  ,ak_^)  is  piecewise  linear  and  convex  on  W  for 

all  k=0,... 

,K. 

(b) 

#* 

O 

II 

*» 

VI 
— i 
o 

. .  ,K. 

(c) 

for  N=2,jf= 

V! 

m 

• 

• 

• 

•* 

o 

II 

■“D 
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.  /  - 


V.e  now  examine  in  more  detail  the  determination  of  A^a0,. . .  ,a^ )  from 
k'f’l 

(a0, — ,a^  ^ ,a^) ,  for  all  a^eA^.  Observe  that  this  determination  is 
analogous  to  determining  A'  from  A (a)  ,E(a) ,  and  Qe(a),  for  all  a  e  A,  where: 

max  na'  =  max{np(a)+SG[4  (a) ,E(a) ,Q  (a) ,n]} 
a  e.  A  acA  e 

Consider  the  following  procedure: 

(1)  For  each  a  e  A(a)  and  for  any  n»  determine  Qa(a)  such  that  nQa(a)a  * 
min  {r)Qea:l<e<E(a)}.  Put  p(a)+BQa(a)a  into  AT(a). 
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(2)  Determine 


z*(a)=min  max  n'cx 
ri'eN  acA(a) 

and  put  p(a)+3lz*(a)  into  Ay(a).  Note  that 
z*(a)=minimum  z 

subject  to:  z  >  na  ,  a  e  A  (a) 

In  -  i 
n  >  o. 

J3)  Once  steps  (1)  and  (2)  have  been  accomplished  for  all  a  e  A, 
remove  all  vectors  in  l/aAy(a)  that  do  not  achieve  the  maximum  in  max  (na: 
aeU,aAT(a)}  for  any  n  e  W.  (See  Smallwood  and  Sondik  (1973)  for  a  procedure 
for  removing  such  vectors.)  Then,  A'  is  the  collection  of  all  vectors  in 
UaAy(a)  that  have  not  been  removed. 


UPPER  BOUNDS  FOR  THE  MAXIMAX  PROBLEM 


Piecewise  linear  and  convex  upper  bounds  are  now  determined  for  Lk. 

A  procedure  for  computing  these  bounds  is  presented. 

Assume  A2  holds  for  all  Mk.  We  will  recursively  construct  the  function 

Ly  and  the  set  of  vectors  By  as  follows.  Let  B^(a° . aK_1)  =  {pK(a0,... .a1^"1)} 

and  Ly(nK,a0,... ,aK-1)  =  nKPk(a° . aK_^).  Assume  8y+1(a° . ak)  is  known 

and  that  Ly+1 (nk+1 ,a0,. .. ,ak)  *  max  {nk+1a:a  e  By+1 (a0,. . . ,ak)}.  By  Lemma  4(c) 
I(8,E,Qe,n)  is  piecewise  linear  and  convex  on  SI.  Thus,  for  each  a^eA^.^K, 

Ly(nk,a°,...,ak)  =  nkPk(a°... .  ,ak)  +  Bl(B,E,Qe,Ti) 

is  piecewise  linear  and  convex  on  SI,  where  B=By+^ (a0, . . . ,ak) ,  EsEk(a0,. . . ,a“) , 
and  Qe=Qk(a°,...,ak).  Define 

1-M(nk,a° . a11'1)  =  max  i.y(nk,a0 . ak), 

which  is  also  piecewise  linear  and  convex  on  SJ,  and  hence  there  is  a  set 

By(a0,. . . ,ak“^)  such  that  Ly(nk»a°, . . . ,ak_1 )  *  max  {nka:aeBk(a° . ak-1)}. 

PROPOSITION  3.  Assume  Mk(*  ,a°, . . . ,ak)  satisfies  A2  for  all  a^cA^,£=0, . . . ,k 
and  all  k=0,...,K-l.  Then, 

(a)  Ly(*  ,a0,. . .  ,ak-"')  is  piecewise  linear  and  convex  on  SI  for  all 
k=0 , . . . , K , 

(b)  Lk<Ly  ,  k=0,...,K. 
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k  .  . 

We  now  examine  in  more  detail  the  determination  of  B,.(a0,... ,aK“1)  from 
Bjj(a  °...,a^  ^.a^),  for  all  a^eA^,  which  is  analogous  to  determining  B' 
from  8(a), E(a),  and  Qe(a),  for  all  a  e  A,  where: 

max  na'  »  max  (np(a)  +  BI[B(a) ,E(a) ,Qe(a) ,n]). 
a'eB'  acA 

Consider  the  ful lowing  procedure: 

(1)  For  each  a  e  8(a)  put  p(a)+£Qea  into  By(a),  where  ec{l . E (a) } 

is  such  that  for  any  (and  hence  all)  neW,  n(Qe-Qe')a>0  for  all  e'e{l . E(a)). 

(2)  Once  step  (1)  has  been  accomplished  for  all  a  e  A,  remove  all  vectors 
in  Ua8T(a)  that  do  not  achieve  the  maximum  in  max{na:acUaBT(a)}  for  any 

n  e  W.  Then,  B'  is  the  collection  of  all  vectors  in  UaBy(a)  that  have  not  been 
removed. 
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UPPER  (LOWER)  BOUNDS  ON  JK(LK): 


Piecewise  linear,  convex  upper  (lower)  bounds  are  determined  on 

k  k 

J  (L  );  a  procedure  for  computing  these  bounds  is  presented.  Assume  A2  holds  for  all 

k  k  i  i 

Let  J*  and  L*  be  defined  as  are  0K  and  LK  except  assume  the  evolution 
of  the  trade-off  vectors  is  constrained  by  the  sets  A'*(nk»a0,. . .  .a*4). 

PROPOSITION  4.  (a)  Assume  that  Mk(rik, a0, ... ,ak)  £=  Mk(nk,a°, ... ,ak)  for  all 

n^.a0,. . .  ,a*S  and  k.  Then,  O^jk*  Lk<Lk,  for  all  k=0,...,K. 

(b)  Assume  that  there  is  a  matrix  F^(a°  , . . . ,a^)  such  that  {nkFk(a0, . . . .a^)}®  - 
k 

M*(n^.a0,, . .  ,a^)  for  all  n^.a0,... ,ak,  and  k.  Then,  Z^=0^=L^  is  piecewise 
linear  and  convex  on  N  for  all  k.  Furthermore,  if  n*<F*c(a0,. . .  ,a'c)EM^(n*c,a0,. ..  .a*4) 
for  all  nk,ac,. . . ,aK,  and  k,  then  there  exist  a  piecewise  linear  and  convex  j 

upper  bound  on  J*'  and  a  piecewise  linear  and  convex  lower  bound  on  L^.  for 
all  k-0,...,K. 

« 


We  remark  that  if  F  is  a  stochastic  matrix,  then  n  e  W  implies  n  F  e  W. 
Therefore,  in  seeking  piecewise  linear  and  convex  upper  and  lower  bounds  on 

L  and  J  ,  respectively,  it  is  desirable  to  seek  stochastic  F^a0 . a^). 

One  such  matrix  is  the  identity  matrix;  thus,  if  the  "status  quo"  is  a 
possibility,  i.e.  if  r,  t  W^(ri,a0, . . .  ,a^)  for  all  n»a0,. . .  ,a*S  and  k,  then  such 
bounds  exist. 

Observe  that  when  there  is  a  matrix  Fk(a°, . . . ,ak)  such  that  {nkFk(a°,. . . ,ak)}= 
,a°,...,ak)  for  all  nk>  a0,. . . ,ak,and  k,  then  Lk  can  be  determined 


recursively  as  follows: 


f  ■  ■  . 


^(nk) 


=  max 


ikcAk 


-kJC/.O 
n  P  (a  , 


+Smax{rikFk(a0, 


)a:acA 


k+1 

★ 


where  L*(nK,a°,...,aK"^)  *  nKpK(a°,...,aK"'1)  and  /£+1(a° . ak)  is  such 

that  L*  \n*C+^»a°»*..»a*c)  =  max{n*<+^a:a£A*+^  (a0,. . .  ,ak)}.  Determination  of 
A*(a0,. . . ,ak-1 )  from  A*  1 (a0,. . . ,ak_1 ,ak) ,  for  all  akcAk,  is  analogous  to 
determining  A'  from  A(a)  and  F{a),  for  all  a  e  A,  where: 


max  >]u' 
a'eA' 


maA  ' 

acA 


np(a)  Bmax{nF^a)a:acA(a)} 


I 


Consider  the  following  procedure: 

(1)  For  each  a  e  A{a),  put  p(a)+SF(a)a  into  Aj-(a). 

(2)  Once  step  (1)  has  been  accomplished  for  a  e  A,  remove  all  vectors 
in  UaAj-(a)  that  do  not  achieve  the  maximum  in  max{na:acUaAj(a)}  for  some 

n  c  W.  Then,  A'  is  the  collection  of  all  vectors  in  UaAj(a)  that  have  not 


been  removed. 


THE  FINITE  Aik  CASE: 

Thus  far,  our  assumptions  describing  the  form  of  the  M  have  been 
primarily  motivated  by  what  information  a  DM  might  be  able  to  provide  with 
regard  to  their  form.  We  then  developed  various  analytical  results  that 
provided  insight  into  how  alternatives  should  be  selected  and  information 
regarding  what  should  be  expected  if  the  alternatives  were  so  selected. 

For  completeness,  we  now  reexamine  the  basic  model  with  the  primary  concern 
being  tractability.  This  reexamination  is  accomplished  in  two  ways,  both 
involving  finite  M  sets.  First,  we  consider  the  maximax  problem  under  the 
assumption  that  all  elements  in  Mk(nk,...)  are  linear  in  nk  and  are  members 
of  bl.  We  then  show  that  Lk  is  piecewise  linear  and  convex  and  hence  easily 
computable.  Second,  we  assume  that  there  exists  a  probability  distribution 

k-r- 

on  M  and  develop  conditions  which  guarantee  that  the  solution  of  the  resulting 
DPE  is  piecewise  linear  and  convex.  Interest  in  such  an  approach  is  due  to 
the  possibility  that  mechanisms  M  and  B  may  be  highly  unrealistic  ways  of 
modeling  the  selection  of  nk+^  from  Mk.  Interesting  ar.d  direct  analogies  are 
drawn  between  the  probabilistic  results  and  Bayes'  Rule  and  an  algorithm  due 
to  Smallwood  and  Sondik  (1973).  We  remark  that  the  maximin  problem  is  not 
considered  under  the  assumption  that  the  Mk  are  finite.  Unfortunately,  Jk 
is  no  longer  convex  under  this  assumption  and  hence  is  relatively  intractable. 

The  Maximax  Problem.  Assume  Mk(nk,a°, ... ,ak)  =  (nkQek(a°, . . . ,ak) :e=l , . . . , 
Ek(a°,...,a  k)  }  and  that  Qek(a0,. ..  ,ak)  is  stochastic  for  each  e,  for  all 
nk,a0,. . . ,ak,  and  k.  A  straightforward  reexamination  of  the  proofs  of  Lemma  4(c) 
and  Proposition  3  in  light  of  these  assumptions  implies  the  following  result. 
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PROPOSITION  5.  Lk=Lk,k=0,...,K. 

Thus,  Lk  is  now  easily  computable  and  is  as  computable  as  its  upper  bound 
was  under  the  hypotheses  of  Proposition  3. 

A  Probabilistic  Approach.  Assume  probabilities  of  the  form 

Pk[nk+1 (e) |r|k,a0 . ak], e=l (a0,. . . ,ak) ,  are  given,  where  MK(nk,a0,. . . ,ak) 

(nk+1 (e),e=l ... . ,Ek(a0,. . . ,ak)}.  We  shall  call  this  mechanism  for  selecting 
nk+1  from  Mk  mechanism  P.  The  associated  DPE  is  Zk=H^Zk+1 ,  where: 


7-  (ri  ,a  .  ,a  )  -  n  p  (a  ,...,a 


. a«-',,\v) 


k-1  ,k 


k  kr, o  ,kx 

n  p  (a  . ,a  ) 


+6leP[nk+1 (e) |.tk,a°, . . . ,akMnk+1 (e)] , 

♦  [Hkv](nk,a0,. . . ,ak"h 

=hk[nk,a°,...,ak"1,S(nk,a° . ak'’),v]. 

•  Hkv  =  sup  Hkv. 

6  o 

Call  the  strategy  composed  of  policies  which  achieve  the  supremum  in 
Zk=HkZk+^  an  optimal  expected  strategy. 

In  order  to  insure  piecewise  linearity  and  convexity  of  the  Zk,  assume 
that  if  nk+1 (e)cWk(nk,a° . ak),  then  there  is  a  Qk(a0,. .. ,ak)  such  that 
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*k+1(e)  ■  nkOJa° 


....,ak)/P 


P[nk+1(e)|r,k,a°,...,ak]  . 


In  order  to  insure  that  rik+^(e)e  W  for  all  nk>  assume  further  that 

Qe(a0,. . . ,ak)  has  all  nonnegative  elements  and  that  P[nk+^ (e) |nk,a° . ak] 

acts  as  a  normalizing  term;  i.e., 

nkQe(a°,...,ak)l  =  P[nk+1 (e) |nk,a° . ak] 


Since  [eP[nk+1 (e) jnk,a°, . . . ,ak]  =  1, 


^^eQe^a°’*‘*’ak^j  =  1 


for  all  i=l,...,N.  Under  these  assumptions,  Qk(a°, . . . ,ak) . .  can  be  interpreted 
as  the  probability  that  a  controlled  Markov  process  will  go  from  state  i  at 
stage  k  to  state  j  at  stage  k+1  and  e  is  a  presumably  noise  corrupted  observa¬ 
tion  of  the  state  at  stage  k  and/or  k+1.  Note  also  that  under  these 
assumptions  nk  can  be  interpreted  as  an  a  priori  probability,  where  nk'r^(e)  is 
the  a  posteriori  associated  with  observation  e.  Thus,  the  problem  is  a  slight 
generalization,  at  least  in  form,  of  the  partially  observed  Markov  decision 
process,  a  solution  procedure  for  which  is  presented  in  Smallwood  and 
Sondik  (1973). 

We  remark  that  it  is  unlikely  that  the  Q*  could  be  assessed  directly  and 

that  probably  what  could  be  assessed  for  a  given  nk,a° . ak  is  Ek(a0,. . . ,ak) 

and  r)k+^(e),e=l,...,Ek(a°,...,ak).  We  would  therefore  have  the  following 
linear  feasibility  problem:  given  n  c  N,  E,  and  n’(e)eW,  e=l,...,E,  determine  . 
Qe(i ,j)  such  that 
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Qe(i»j)>0  for  all  e.i.j 


IeIjQe^  ’^=1  for  a11  1 

n'(e)=nQe/nQel  for  all  e 

Note  that  there  are  N2E  unknowns  and  N+(N-1)E  constraints.  If  we  wished  to 
assume  values  for  P[n'(e)|n]  *  nQel  »e=l . . ,E,  e.g.,  P[n'(e)|n]  *  l/E, 
then  there  would  be  an  additional  E-l  constraints.  Procedures  for  determining 
a  solution(s)  co  the  above  problem  are  discussed  and  presented  in  Matneiss 
and  Rubin  (1980). 


SU30PTIKAL  DESIGNS 


Throughout  this  paper,  we  have  presented  approaches  for  determining 
Zk  or  bounds  on  Zk  for  three  different  mechanisms  for  selecting  nk+^  from  Mk: 

1.  mechanism  M,  which  resulted  in  strategies  that  provide  upper 
and  lower  bounds  on  Jk,k=Q,... ,K. 

2.  mechanism  B,  which  resulted  in  strategies  that  provide  upper 
and  lower  bounds  on  Lk,k=0,...  ,K,  and  which  for  the  finite  Mk 
case  considered  resulted  in  strategies  that  provide  Lk,k=0,...K. 

3.  mechanism  P,  which  for  the  finite  Mk  case  considered  resulted 
in  strategies  that  provide  Zk,k=0,... ,K. 

A  procedure  for  selecting  alternatives  based  on  a  given  preference  evolution 
mechanism  is: 

T.  At  stage  k,  select  alternative  ak=6k(nk.a°, . . . ,ak-1 ) ,  where 
7F{6k,k=0,. . . ,K)  is  a  strategy  associated  with  the  given 
preference  dynamics. 

2.  Let  the  actual  (vhich  is,  of  course,  likely  to  differ  from  the 

k+1 

assumed)  preference  dynamics  provide  the  DM  with  n  .  Let  k=k+l , 
and  return  to  step  1. 

This  procedure  is  identical  to  Witsenhausen's  assumed  permanance  procedure 
where  now  what  is  assumed  to  be  permanent  is  the  mechanism  which  determines 
the  path  of  the  trade  off  weight  process.  Note  also  that  this  procedure 
generates  a  "closed-loop"  feedback  strategy.  We  remark  that  bounds  determina¬ 
tion  in  Section  7  which  assumed  that  Mk  was  a  single  point  produced  an  open- 
loop  strategy;  use  of  the  above  procedure  with  such  a  strategy  produces  an 
open-loop  feedback  strategy  (see  Bertsekas  (1976),  Sections  5.3,  5.4,  and  5.5 
for  further  discussion). 


An  alternate,  and  perhaps  more  behaviorally  compatible,  procedure  would 
be  to  select  the  preference  evolution  mechanism  to  be  used  for  alternative 
selection  at  each  stage,  depending,  perhaps,  on  the  mood  of  the  DM  and/  or 
his  impression  of  under  what  mechanism  preference  is  evolving.  Obviously, 
many  other  alternate  approaches  for  alternative  selection  are  possible. 

Of  course,  none  of  the  descriptions  of  preference  dynamics  considered  here 
are  likely  to  be  entirely  accurate;  therefore,  the  resulting  strategies 
are  perhaps  best  viewed  as  suggestions  or  "rules  of  thumb"  rather  than 
procedures  for  selecting  alternatives  without  further  thought. 


A  HYPOTHETICAL  EXAMPLE 


We  now  present  an  example  and  associated  numerical  results  for 
mechanisms  M  and  B.  Consider  a  newly  certified  individual  who  is  faced 
with  promotion  or  dismissal  in  three  years.  (The  number  of  years  and 
hence  stages  considered  has  been  chosen  for  xomputational  ease;  in  the 
context  of  this  example,  a  more  realistic  number  would  be  six.)  Assume  the 
two  objectives  under  consideration  are  (1)  research  productivity  and  (2) 
teaching  proficiency.  The  individual  wishes  to  take  a  course  of  action 
that  will  maximize  his  (or  her)  perceived  value  at  the  time  of  the  "up  or 
out"  decision.  The  individual  is  faced  with  the  likelihood  that  the 
current  relative  importance  of  the  objectives  will  change  over  the  planning 
horizon.  In  the  context  of  this  example,  our  model  requires  us  to  assume 
that  the  individual  knows  precisely  the  current  relative  importance  of  the 
objectives  and  that  there  is  only  one  outcome  for  each  alternative  selected. 

Assume  that  A  ={0,1 },k=0,l ,2,  where  0  =  emphasize  teaching  and  1= 
emphasize  research.  Assume  also  that  8=1.  p^=0  for  all  k=0,l,2,  and  that 
the  terminal  value  p3  is  such  that 

p3(a0,a’.a2)  -  p(a°)+p' (a’)+p"(a2) 


where: 


p  (0)  - 

■  0 1  p  (1)  - 

i ' 

81 J 

.0. 

p'(0)  = 

r  o  i  p’d)  - 

.9 

LJ 

0 

^  •* 
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(i)  -  r. si- 

_  o . 


These  values  reflect  two  apparently  realistic  perceptions.  First, 
research  accomplished  three  years  ago  (presumably  resulting  in  a  very 
recent  publication)  is  more  valuable  now  than  research  accomplished  two 
years  ago  (presumably  awaiting  publication)  which  is  in  turn  more  valuable 
than  research  accomplished  last  year  (presumably  awaiting  reviewer 
comments).  Second,  recent,  high  quality  teaching  is  better  remembered 
ar.d  hence  mors  valuable  than  less  recent,  high  quality  teaching. 

Let  /.^(n’Sa0,. . .  ,a^)  =  M^(n^)  *  (n'eW:  -esn^-n'se).  We  consider  three 
cases: 

(a)  the  maximin  case  for  e*0.1 

(b)  the  maximax  case  for  e-0.1 

(c)  the  e=0.0  case  (i.e,  the  trade-off  weights  are  assumed  to  be  static). 
Use  of  the  algorithms  developed  in  Sections  5,  6,  and  7  provide  the  following 


results: 
.  0 


-0.813 

1.897 


0.813 

3.523 


1.312 

1.312 


3.523 

0.813 


1.897 

-0.813 


1.9  ,  2.71 

L  0  J  L  °J 


Graphs  of  the  associated  functions  are  presented  in  Figure  1.  Mote  that 


By 


J  <Z  <L  ,  as  expected.  The  strategies  associated  with  these  cases  are 
“  U 

presented  in  Table  I. 

We  remark  that  these  strategies  exhibit  significantly  different  behavioral 
characteristics.  Note  that  both,  the  maxi  min  strategy  and  the  permanent 
preference  strategy  encourage  an  early  interest  in  research  and  a  later 
interest  in  teaching,  where  the  encouragement  on  the  part  of  the  maximin 
strategy  to  have  "all  bases  covered"  is  comparatively  quite  strong.  The 
strategy  determined  from  the  upper  bound  on  ,  however,  suggests  initially 
determining  a. preference  (presumably,  on  the  part  of  a  promotions  committee) 
toward  one  of  he  two  objectives  and  then  emphasize  the  attainment  of  value 
associated  with  that  objective  over  the  entire  problem  horizon.  Such  a 
strategy  makes  sense  under  the  assumption  that  mechanism  B  is  in  effect 
since  mechanism  B,  i.e.,  the  promotions  committee,  is  watching  the  alternatives 
selected  by  the  individual  and  changing  its  view  of  the  relative  importance 
of  the  objectives  so  as  to  increase  the  individual's  perceived  value  as  much 
as  possible  at  the  end  of  the  three  year  period.  We  suspect  that  many  would 
feel  that  mechanism  B  is  an  unrealistic  model  of  how  a  typical  promotions 
committee  establishes  criteria  for  promotion. 


CONCLUSIONS 


We  have  presented  a  model  of  sequential  decisionmaking  under  uncertain 
future  preferences.  We  have  claimed  that  the  dynamic  preference  model  which 
has  received  primary  attention, ' set  inclusion  and  mechanisms  B  and  M,  provides 
few  constraints  on,  and  hence  enhances,  the  assessment  of  the  dynamic 
structure.  The  validity  of  this  claim  requires  future  examination;  appro¬ 
priate  assessment  procedures  have  yet  to  be  developed. 

Although  we  have  attempted  to  justify  the  decisionmaking  model's 
validity,  primary  emphasis  has  been  placed  on  examining  the  model's  tract- 
ability.  Algorithms  have  been  developed  which  provide  upper  and  lower 
bounds  on  the  optimal  value  functions  of  interest,  and  strategies  associated 
with  these  bounds  have  been  obtained.  Circumstances  have  been  investigated 
as  to- when  these  bounds  are  exact.  We  remark  that  the  maximax  results  can 
be  used  to  give  the  DM  an  insight  as  to  how  to  exert  control  over  the 
tradeoff  weight  vector  evolution,  if  he  is  able  to  exert  such  control. 

Two  directions  for  future  research  appear  to  be  particularly  worthwhile 
from  the  perspective  of  model  validity:  (1)  generalizing  the  model  to 
include  a  probabilistically  evolving,  perhaps  partially  observed  state,  and 
(2)  relaxing  the  requirement  that  the  current  tradeoff  weight  vector  is  precisely 
known.  The  former  direction  would  allow  the  insertion  of  chance  nodes  in  the 
decision  tree,  which  would  permit  the  combination  of  the  model  of  future  preference 
uncertainty  presented  in  this  paper  and  the  model  considered  by  Kreps  (1975,  1977). 
The  latter  direction  would  allow  the  decisionmaker  to  be  unsure  and/or  purposely 
vague  about  current  tradeoff  weights. 
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TABLE  1:  The  (a)  Maximin  Strategy  for  e=0.1,  (b)  Strategy  Associated  with 
the  Maximax  Problem  for  c=0.1,  and  (c)e=0.0  Case,  for  the  Exampl 
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Proof  of  Lemma  1 ; 

Assume  nmieA{(n‘i)  for  all  m  and  that  lim  v ( fjm1 )  =  g(n^ ) » 1=1 ,2.  We 

m 

note  that 

gExnMl-xJn2] 

<  lim  inf  v  [Xt^+CI-X)^1"2] 
m 

r  XI in:  v'^Hl-  xnim  /(if2) 

m  m 


=  Xg(n1)+(l-x)g(n2). 


where  the  second  inequality  is  due  to  the  convexity  of  v. 
Proof  of  Proposition  1: 


Clearly,  is  convex  on  W;  assume  JV+'' 


I 


inf{Jk+1 (n' ,a0,. . . ,ak_1 ,a) :n,eWk(n,a0,.. .  ,ak-]a)} 


is  convex  in  n  on  N  for  each  (a°,. . . ,ak-1 ,a)eAx. . .xAk,and  thus  hk(n,a°, . . .a*"1 ,a,0k+1 
is  convex  in  n  on  N  for  each  (a0, . . . ,ak‘^ ,a)eAx. . .xA^.  The  result  follows  from 
the  fact  that  the  supremum  of  convex  functions  is  convex  and  from  induction.  f  j 


Proof  of  Lemma  2: 


Since  W  is  convex;  it  is  sufficient  to  show  thatM'  satisfies  A1 . 

Let  n ' )  and  n"eM(r^).  Then,  there  exist  {eg}  and  {Og}  such  that 

r‘,=Iecgn1Qe  and  n"=IeCgn2Qe,  where  c^>p,cJ>OtJe^-1,  and  Define 

n^IgOgn^g  and  n"aJeo^n2Qe,  Assumption  2A(ii)  implies  that  n1  CQe-Q.e. )  ■ 
n  (Qe-Qe.)  for  all  e,  e' ,  or  equivalently,  that  (n  -n  )Qe  is  independent  of  e. 

Thus,  [eOg(n2-n1)Qg=Ieag(ri2-n1)Qe,  or  equivalently,  r?  -n's  n"-n".  A  standard 
•n1cebr?.ic  argument,  then  implies  that  Xr.'+(l->)n"  *  x[Xn’+(l-X)  n"]+(l->)rx  n'+(l-X)n 
But  Xn'+(1-X)  n"  and  x  n^+(l-x)n"  are  easily  shown  to  be  members  of  M' [Xi^+O-Xjn2] 
and  hence  so  is  Xn'+(1-X)n".  r“J 

Proof  of  Lemma  3: 

Note  nQea-nQeia  =  n(Qe-Qe')o,  which  is  independent  of  n  due  to  the 
fact  that  neW.  I — l 


Proof  of  LEWiA,  4;  (a)  Piecewise  linearity  and  convexity,  It  is.  sufficient 

to  show  that 


max  mina  nQ»o 
a  e  e 


is  piecewise  linear  and  convex.  From  Lemma  3,  mineQea  is  linear  for  each  aeA. 
The  result  then  follows  from  the  fact  that  the  maximum  of  a  finite  collection  of 
linear  functions  is  piecewise  linear  and  convex. 

G(A,  E,  Qg,  n)  £  g(n).  Let 

★ 

V  be  the  set  of  all  points  in  A/  that  achieve  the  minimum  in 


mi  n  max  net , 

n cN  aeA 


and  define  A/*  =  {n:PflM{n)r$}. 

Assume  neW  .  Then  there  exists  an  n  ePf|M(n)  such  that 


max  n  o  *  mn  max  not. 

aeA  neN  aeA 


For  each  aeA, 


min  n'a  =  min  nQ„ct  <  n  ctj 
n'cM(n)  e  e  ~ 


thus, 


max  min  nQ  ot  <_  max  n  a  =  g(n). 


Let  n^W  .  Then, 


max  min  n.Q.a 

&  c  S 


4 

<_  min  max  nQaa 

=  min  max  n’a  =  g(n). 
n’eM(n)  eeA 

where  the  inequality  is  due  to  Rockafellar  (1970),  Lemma  36,1,  and  the  first 
equality  follows-  from  the  assumption  n^W*. 

(b)  Since  the  lower  bound  is  exact  for  all  N  on  bl* ,  we  wish  to  show  that  the 
lower  bound  is  exact  on  W  complement  when  N=2.  The  sum-to-one  property  of 
elements  in  W  allows  us  to  assume  that  n  e  R  and  hence  M(n)»  for  any  n  e  W, 
vir  have  (?t.  most)  tv/ 3  extreme  points,  n"1  and  n2.  In  gorera! , 

max  min  nQ  a 
a  e  e 

.  .  *  max  min  n'a  <  g(n) 

“  n'eM(n)  - 

<  minQ  max  nQ„a 
—  e  a  e 

whue  the  equality  and  the  second  inequality  are  obvious  and  the  first  inequality 
is  due  to  Rockafellar  (1970),  Lemma  36.1.  Thus,  it  is  sufficient  to  show  that 

max  min  nQ„a  =  mina  max  nQ„a. 

Ct  6  6  6  ct  6 

*12  *  *  e  11* 

Assume  n  <n  <ji  for  any  n  tV ..  Then,  mmemaxan  a  =  max^n  a=n  a  . 

We  now  wish  to  examine  max  min  nea.  Note  that  neo  >nea,  e=l,2,  for  any 

a  e  — 

*  *  1 

a  such  that  na  has  negative  slope,  (na  has  nonnegative  slope  since  n  <r»  and 
e  1  * 

minemaxari  a=n  a  .)  Thus,  we  can  eliminate  consideration  of  any  a  e  A  such  that 
na  has  negative  slope.  Now,  for  a's  such  that  na  has  nonnegative  slope. 


mirigr^a.  =  tv  a,  and  hence  maxaminer)ea  =  ma^ri’a  =  n"*  a* .  A  similar  argument 
holds  if  n1  <r,2<n* ,  for  any  n*cP*. 

(c)  Clearly,  I(A,E,Qe,n)  is  piecewise  linear  and  convex.  A  simple 
argument  proves  that  maxn.maxan'a  =  maxamaxn.n'a.  Note  that  when  n  is  such 
that  nQeeW  for  all  e,  max^in'ot  =  maxenQea.  When  there  is  an  e  such  that 
nQe£N,  /•Kn)£LCH{nQe>l<e<E}  and  M(n)rCH{nQe»l<e<E};  therefore,  max^n'cS 
maxenQea.  |  | 

Proof  of  Proposition  2: 

(a)  The  construction  of  and  induction  guarantee  that  is  piecewise 
linear  and  convex  on  N  for  all  k=0,...,K. 

(b)  Clearly,  assume  Application  of  Lemma  4(a) 

implies -that 


Jk(nk,a0 . ak) 

Shk(nk,a°,. ..  ,ak"1  ,ak,j£+1) 

<hk(nk,a° . ak-1,ak,Jk+1) 

for  all  akeAk.  Thus,  Ok(nk,a0,,..,ak'^)<Jk(nk,a°,...,ak_h,  and  the  result 
follows  by  induction. 

(c)  An  argument  similar  to  part  (b)  and  use  of  Lemma  4(b)  provides 


the  result. 


Proof  of  Proposition  3: 

The  proof  of  part  (a)  is  identical  to  the  proof  of  Proposition  2(a). 

Proof  of  part  (b)  is  analogous  to  the  proof  of  Proposition  2(b),  using 
Lemma  4(c)  rather  than  Lemma  4(a). 

Proof  of  Proposition  4: 

(a)  Follow  directly  from  the  definitions, 

(b)  The  fact  that  J*  *  L*  for  all  k  is  a  result  of  the  fact  that 

G(A,  E,  Qg,  n)  =  I  (A,  £,  Qg,  n)  when  E=1  and  nQ-jcW  for  all  [ _ J 
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ABSTRACT 


We  present  and  analyze  a  generalization  of  the  standard  decision 
analysis  model  of  sequential  decisionmaking  under  risk.  The  decision 
tree  is  assumed  given  and  all  probabilities  are  assumed  to  be  known 
precisely.  Utility  values  are  assumed  to  be  affine  in  an  imprecisely 
known  parameter.  The  affine  form  is  sufficiently  general  to  allow  impor¬ 
tance  weights  or  the  uti'ity  /aluts  themsfe'i  ^es  to  be  represented  by  the 
imprecise  parameter.  Parameter  imprecision  is  described  by  set  inclusion. 

A  relation  on  all  available  alternatives  is  assumed  given  for  each  decision 
node.  The  intent  of  each  (not  necessarily  complete)  relation  is  to  model 
the  decisionmaker's  directly  expressed  preferences  among  the  available 
alternatives  at  the  associated  decision  node.  A  numerical  procedure  is 
developed  to  determine  the  set  of  all  strategies  that  may  be  optimal  and 
the  corresponding  set  of  all  possible  parameter  values.  An  example 
illustrates  the  procedure. 
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I.  lNTRODUCT IGN 

The  s  t  antiarc)  decision  ana)  ysi  s  mode)  of  sequential 
decisionmaking  under  risk  (Keeney  and  Kaiffa,  1976)  assumes  chat 
tne  decision  tree,  tact  information  in  the  form  of  prooabi 1 i ties, 
and  preference  information  in  the  form  of  utilities  are  known 
precisely.  Given  such  structural  and  parameter  value  information, 
the  decision  analysis  paradigm  provides  an  optimal  strategy, 
i.e.,  a  best  alternative  to  select  at  each  decision  node  in  order 
to  maximise  expected  utility. 

In  reality,  utilities  and  probabi 1 i ti es  may  be  difficult  to 
precise: v  assess  (aue  to,  for  example,  the  time  and  stress 
associated  with  their  assessment)  and  may  not  need  to  be 
precisely  assessed  in  order  to  determine  information  sufficient 
for  strategy  selection;  see  Fishburn  (1965),  Sarin  (1977a, b),  and 
Whits,  et  r.i  .  ,  U?63,  1932a >  for  further  discussion.  Furthermore, 
the  decisionmaker  may  be  willing  and  able  to  directly  provide 
information  about  the  relative  desirability  of  the  available 
alternatives  for  at  least  some  of  the  decision  nodes  in  the  tree; 
e.g.,  a  physician  may  be  willing  ana  able  to  directly  express  a 
preference  for  selecting  diagnostic  test  A  over  diagnostic  test  B 
in  diagnosing  patients  having  a  specific  collection  of  signs, 
symptoms,  anc  laboratory  test  results.  Tnus,  the  input 
assumptions  associated  with  the  standard  decision  analysis  model 
may  be  sufficient! v  demanding  to  act  as  a  barrier  to  the 
acceptability  of  tne  decision  analysis  paradigm  and  yet  may 
ignore  resaily  available  inf ormati on  that  could  be  of  significant 
value  in  strategy  selection. 

In  this  paper,  we  assume  that  the  decision  tree  is  given  and 


'chat  all  probabilities  are  known  precisely.  We  then  diverge  -from 

the  aforementioned  input  assumptions  -for  the  standard  decision 

analysis  model  by  assuming  that  utility  values-;  may  be  imprecisely 

described  as  being  members  of  given  sets  and  that  a  (possibly 

null,  not  necessarily  complete)  preference  relation  on  the  set  of 

all  available  alternatives  is  given  far  each  decision  node.  Set 

•inclusion  has  been  selected  as  a  model  of  parameter  imprecision 

due  to  its  simplicity  and  behavioral  justifiability.  The  intent 

of  the  relations  is  to  model  the  decisionmaker’s  directly 

expressed  preferences  among  the  available  alternatives  at  each 

decision  node.  The  problem  formulation  to  oe  examined  thus 

includes  two  interesting  cases: 

(i)  the  standard  decision  analysis  model  of  sequential 
decisionmaking?  i . e. ,  the  case  where  the  utilities  are 
described  precisely  and  where  all  relations  are  null,  and 

< i i )  the  inverse  decision  analysis  problem;  i . e. ,  the  case 
where  the  utilities,  or  some  aspect  of  the  utilities  such  as 
the  importance  weights,  are  unknown  and  where  the  relations 
are  sufficiently  discriminating  to  provide  an  optimal 
p  o  1  i  c  y . 

We  remark  that  the  output  of  the  inverse  decision  analysis 
problem  is  the  set.  of  all  utilities  that  permit  the  given 
strategy  to  be  optimal  and  that  the  general  problem  of 
determining  the  set  of  all  parameter  values  for  which  a  given 
ftrateav  is  optimal  has  been  examined  in  a  variety  of  contexts, 
e.  a. .  control  theory  (Casti ,  1980),  mathematical  programming 

(Pit ran  ef  a!.,  1  1  )  ..  and  decision  anal v= is  ( White  et  al  ..  , 

1 9 8 2b).  W e  t h e n  d e v e  1  o p  an  a n a  1  y tic  pro c e d u. re  f o r  d e t e r mini  n g  the 
set  of  all  strategies  that  may  be  optimal  and  the  correspond! ng 
set  of  utility  values.  This  analytic  procedure  serves  as  the 
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numerical  procedure  that  is  a  cisneral  i^ati  on 


•sei  it  ad 


in  (Whits  and  El  Dei b. 


fohite.  et  a. 


paper  is  outlined  as  follows.  The  general i 
decision  analysis  model  is  formulated  in  Section 
in  Section  III.  A  numerical  example  is  presented 
Conclusions  are  discussed  in  the 


final  section 


II.  PROBLEM.  FORMULATION 

Assume  that  a  K  stage  decision  tree  is  given.  For  notational  sim¬ 
plicity,  we  will  assume  that  the  appropriate  number  of  decision  nodes  with 
single  actions  and  chance  nodes  with  single  outcomes  have  been  added  to 
branches  having  less  than  K  stages  in  order  to  insure  all  branches  have 
exactly  K  stages.  Let  Sk  be  the  finite  set  of  all  stage  decision 
nodes,  k=0,l ,. .. ,K-1 ,  and  let  be  the  finite  set  of  all  terminal  nodes. 
The  finite  set  A(sk)  represents  the  set  of  all  alternatives  available  for 
selection  at  decision  node  s^eS^,  k=0,l ,. . .  ,K-1 .  If  alternative  akeA(sk) 
is  selected  at  decision  node  skeSk,  then  the  resulting  realization  of  the 
rardom  variable  associated  with  the  appropriace  chance  node  is  restricted 
to  be  a  member  of  the  finite  set  Z(sk,ak),  k=0,l , . . . ,K-1 .  The  probability 
that  realization  zk+^eZ(sk,ak)  will  result  after  selecting  alternative 
akeA(sk)  at  decision  node  skeSk  is  p(zk+1 )sk,ak) ,  which  we  assume  is  given 
precisely.  We  assume  throughout  for  each  k=0,l , . .. ,K-1 ,skeSk,  and 

akeA(sk)  >  that  pCzk+i  f sk ’ak^  for  zk+leZ^sk’ak^  and 


zk+l£Z< 


P(z 


sk’V 


k+1 


sk’ak^  = 


Mote  that  sk+1  =  (sk’ak’zk+l^  with  Probabiliby  P(zk+i lsk >ak) .  Thus 
{sk»k=0,l »• is  a  controlled  Markov  chain. 

Let  u(s„)  be  the  utility  accrued  at  terminal  node  s^eS,,.  Assume  for 
K  N  r\ 

each  s^eS^  there  is  a  given  scalar  u^(sk)  and  a  given  N-vector  ^(s^)  = 
row{uj(sK) ....  ,Uj^( sK) }  such  that 

u(.sK)  =  u°(sK)  +  Ul(sK)P, 


where  the  N-vector  p  =  col{p-| ,. . .  ,p^} ,  the  imprecisely  known  parameter,  is 
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assumed  to  be  a  member  of  the  given  set  PCIR  . 

The  above  description  of  utility  imprecision  is  sufficiently  general 

to  allow  for  several  interesting  cases  of  parameter  imprecision.  For 

example,  assume  p  is  the  vector  of  importance  weights  for  a  multi  attribute, 

sequential  decision  analysis  problem,  N  is  the  number  of  attributes,  p  is 

n 

the  importance  weight  of  the  nth  attribute,  u°(sK)  =  0,  and  u^(sK)  is  the 

utility  accrued  at  terminal  node  sK  with  respect  to  attribute  n.  Then 

PCL{pdR^:pn  >_0,  £nPn  =  1}  represents  the  set  of  all  possible  importance 

weight  vector  values.  As  another  example,  assume  for  each  s^eS^,  u(sk)  is 

imprecisely  known.  Let  N  equal  the  number  of  elements  in  the  set 

SK’  JrVsK^  =  1  ^  n  "  sk  v30  if  n  /  sK) ,  for  all  s^eS^. 

N 

Then  P  {peR  :  0  _<-Pn  <.  1}  represents  the  set  of  all  possible  utility  values. 

Assume  that  the  decisionmaker  has  provided  a  relation  on  the  alter¬ 
natives  at  each  decision  node.  That  is,  assume  that  there  exists  a  set 
R(sk)  c  A(sk)  x  A(sk)  for  each  skeSk,  k=0,l ,. . . ,K-1 ,  where  (ak,ak)ER(sk) 
indicates  that  the  decisionmaker  perceives  alternative  ak  to 
be  at  least  as  preferred  as  alternative  ak  at  decision  node  sk.  If 
R(sk)  3  ? ,  then  the  decisionmaker  has  expressed  no  preference  with  respect 
to  the  alternatives  at  decision  node  sk. 

A  (parameter  independent)  strategy  tt  is  a  rule  that  selects  an  alter¬ 
native  in  A(sk)  for  each  skESk,  k=0,l ,. . . ,K-1 ;  i.e.,  *(sk)eA(sk)  for  each 
skeSk ,  k=0 , 1 , . . .  ,K- 1 . 

The  problem  objective  is  as  follows.  Given: 

1.  the  decision  tree  structure,  i.e.,  K,  S.  for  all  k,  A(*)>  and 

2.  the  probability  structure,  i.e.,  p(*|*,»), 
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A  SOLUTION  PROCEDURE 

We  now  examine  a  procedure  for  achieving  the  problem  objective.  Let 
C  be  a  parameter  dependent  strategy;  i.e.,  let  c(sk ,p)eA(sk)  for  every 
skeSk,  k=0,l , . ..  ,K-1 ,  ptP.  Define  fk(sk,p)  to  be  the  expected  utility 
accrued  if  strategy  g  is  used,  if  p  is  the  value  of  the  parameter,  and  if 
the  problem  were  to  commence  at  decision  node  skeSk.  Define  fk(sk*p)  = 
sup^f^(sk  ,p) ;  i.e.,  fk(sk,p)  represents  the  optimal  expected  utility  accrued 
if  p  is  the  parameter  value  and  if  the  problem  were  to  begin  at  decision 
node  s^.  It  is  straightforward  to  show  that  fk  satisfies  the  following 
dynamic  programming  equation  and  boundary  condition: 


fk(sk,p)  =  max  {h ( sfc ,  P>ak,fk+1)} 
aktA(sk) 


where 


h(sk»o  ,ak  ,v)  =  IZk+1P(zk+i!sk«ak)v(sk,ak,zk+1,p) 


^  K  *  ^  “  u  ( s  ^ ^  u  (s^) p . 

It  has  been  shown  in  White  and  El  Deib  (1982)  that  for  each  skeSk  and  each  k 
^(s^p)  is  piecewise  affine  and  convex  in  p,and  hence  there  exists  a  set 
A(sk)  of  pairs  (a,y)  such  that 

fk(sk>p)  =  max{a  +  YP:(a>Y)eA(.sk)}, 


■V«' 
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It  is  assumed  that  A(sk)  represents  the  smallest  set  of  such  pairs. 

Clearly,  determining  fk(sk,p)  from  fk+-j  is  equivalent  to  determining 
A(sk)  from  A(sk,ak,zk+1)  for  all  zk+1 eZ(sk ,ak)  and  akeA(sk).  The  latter 
determination  can  be  accomplished  by  noting  that 


fk(sk,p)  =  max{max{a‘  +  y'p}} 
ak 

where  the  first  maximization  is  over  all  aj<eA(sk)  and  the  second  maximization 
is  over  all  pairs  (a',y')  of  the  form 

“  3“'(sk’ak'  3  Jz|(+1',*lk+llsk’,k^“'sk’4k’zk+V 
T,-T'tsk*"k)  ■  Jzktl'><zk*ilsk>ak>1'<VVW- 

for  {ct(sk,ak,zk+1),y(sk,ak,zk+1)}eA(sk,ak,zk+1),zk+1eZ(sk,ak).  We  remark  that  if 
a  ^Sk’ak^+Y  ^sk,ak^p  —  **  ^Sk’ak^+Y  ^k,ak^p 


for  all  3|(£:A(S|c)»  then  ak  is  an  optimal  alternative  at  stage  k  for  parameter 
value  p.  Define  5  to  be  such  that  ?*(sk,p)  =  ak;  that  is,  C  represents  an 
optimal  parameter  dependent  strategy.  Note  that  C  satisfies 

VV0’  3  Iv,l’Czk*i|sk1?*tV,,n  Wsk-E*(Vl,Wrl,] 

for  all  sksSk,k=0,l ,. . . ,K-1 . 

The  above  algorithm  for  computing  A( sk)  from  A(sk+-| ).,  sk+-|eSk+i , 
becomes  clearly  more  tractable  as  the  number  of  pairs  in  each  of  the  A( s k+-j ) 
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3.  the  a  priori  parameter  set  ? Q\ R  , 

4.  the  utility  structure  \P:  S^R  and  u^ :  SK»|RN,  and 

5.  the  preference  structure  R{.*14 

determi ne: 

1.  the  set  of  all  strategies  that  may  be  optimal  and 

2.  the  set  of  all  parameter  values  consistent  with 
these  strategies. 


becomes  smaller.  The  number  of  pairs  in  any  of  the  A(sk)  sets  increases  as 
the  imprecision  of  the  parameter  p  increases.  That  is,  let  P'  and 

P"  represent  two  set  descriptions  of  parametric  imprecision,  and  assume 
P'  CP"  C|Rn.  Let  A'(sk)  and  A"(sk)  be  the  smallest  sets  of  pairs  defined 
above  that  generate  fk(sk,p)  for  all  p  in  P'  and  P",  respectively.  Then, 
A'(sk)  ^:A"(sk).  We  now  indicate  how  the  information  contained  in  the 
R(Sjc)  can  be  used  to  efficiently  decrease  parameter  imprecision  as  the 
A(s^)  are  iteratively  determined. 

Defi  ne 


P(sk,a£,ak)  =  {p:h(sk,p,ak,fk+i)  >  h(5»k»p»ak,fk+1,}. 

Thus,  p^sk,ak,ak)  represents  the  set  of  all  parameter  values  which  imply  that 
(ak,ak)eR(sk) ,  assuming  that  the  decisionmaker  will  select  alternatives  in 
the  future  in  a  manner  consistent  with  expected  utility  maximization.  Let 

P(sk)  =flP(sk,a£,ak), 

where  the  intersection  is  with  respect  to  all  (ak,ak)eR(sk) .  If  R(sk)  =  <j>, 
let  P(sk)  =  Define  APk  sfiP(sk),  where  the  intersection  is  with  respect 
to  all  skcSk.  Assume  P^  =  P,  and  let 

Pk  =  APkPPk+r 

Thus,  P^  represents  the  set  of  all  values  that  the  parameter  vector  can 
assume,  given  the  decision  tree,  preference,  and  probability  structures  for 
stages  t=k,...,K,  and  the  utility  structure.  Once  P.  is  known,  it  is  suf- 


ficient  to  determine  A(sk)  for  all  ske$k  in  terms  of  ?k- 

The  above  discussion  suggests  the  following  algorithm  for  determining 
Pg  and  the  set  of  all  strategies  that  are  optimal  for  parameter  vectors  in  P 

0.  Define  PK  =  P  and  A(sK)  =  {u°(sK),  u1^)}  and  fK(sK<P)  = 
u°(sK)^(sK)p  for  all  skeSK  and  peP^.  Set  k=K-l . 

1.  Determine  Pk. 

2.  Determine  A(sk)  for  all  skeSk  with  respect  to  Pk.  Set  k=k-l . 

3.  If  the  strategy  tt  is  such  that  Tt(sk)  =  ?(sk,p)  for  some  pePg 
for  all  sk£Sk,  k=0,l ... . ,K-1 ,  then  it  may  be  an  optimal  strategy. 

The  collection  of  such  strategies  represents  the  sought  after 
set  of  possibly  optimal  strategies. 


IV.  A  NUMERICAL  EXAMPLE 

We  now  present  a  numerical  example  to  illustrate  the  algorithm 

developed  in  the  previous  section.  Consider  the  decision  tree,  and 

probability  and  utility  structures  presented  in  Figure  1,  where  we  assume 

N=3,  u°(s3)  =  0  for  all  s3eS3  =  {301,. ..,315),  u1 (s3)  is  the  3-tuple  next 

3 

to  the  appropriate  terminal  node,  and  P  ={odR  :pn  >.  0,  p-|+  pg+Pg3!}.  We 
interpret  p  to  be  the  vector  of  importance  weights  for  a  3-attribute,  addi¬ 
tive  utility  function.  Assume  also  that 

R(01 ).  =  {(aQ-,,a01),  (ag-pag])} 

R(ll)  =  o 

R(21)  =  f  ( ®21  ,a21^’  ^a21  ,a21  ^  ’  ^a21  *a21  ^ 

R( 25 )  =  {(32^,32^),  (a25 ,a25^  ’  ^a25’a25^* 


Reference  to  Figure  1  indicates  there  are  ten  (10)  available  strategies: 

^i  =  raoi ,all 

*2  =  {a01’all’a21} 

11  3] 

*3  =  {a01,all’a21} 

1  1  4i 

*4  ‘  *aoi,an,a2r 
*5  =  {a01,all} 
n6  =  ^a01,a25} 

*7  s  <a01’a25} 

*8  =  ^a01’a25} 

*9  =  ta01’a25} 

*10  =  ta01}- 
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In  the  context  of  the  notation  introduced  in  Section  2,  tt-j  ,  for  example, 

is  equivalent  to  ir-|(Sg-|)  =  a^,  ^(s^)  *  a^ ,  and  7r-|(s21)  =  a2y 

Note  that  the  preference  information  contained  in  the  R  sets  indicates  that: 

1.  at  least  one  of  the  5  strategies  it^ ,  *2,  *3,  *4,  u5  is  at  least  as 

1  3 

preferred  as  tt10  ((aQ1  ,a01)eR(01)} , 

2.  at  least  one  of  the  4  strategies  irg,  iiy,  irg,  and  ng  is  at  least  as 

2  3 

preferred  as  ir1Q  ( ( aQ1  ,a01)eR(01)), 

3.  tt -|  is  at  least  as  preferred  as  ir4((a2i  .a^-j ) eR( 21 ) ) , 

2  3 

4.  ir2  is  at  least  as  preferred  as  *3( (a2i  ,a2-j ) eR( 21 ) ) , 

2  4 

5.  *2  is  at  least  as  preferred  as  ^((a^  ,a21)eR(21)) , 

1  3 

6.  irg  is  at  least  as  preferred  as  irg((a25,a25)ER(25)) , 

7  2  3 

7*  ny  is  at  least  as  preferred  as  Trg((a25,a25)eF.(25)) , 

8-  it g  is  at  least  as  preferred  as  TTg((a2g,a2g)eR(25)). 

Strategies  ir^,  ir^,  irg,  irg,  and  it^q  are  therefore  likely  to  be  eliminated  as 
contenders  for  most  preferred. 

Boundary  conditions  and  the  values  of  the  h  functions  at  stage  2  are 
presented  in  Table  1.  Recall  that  (a21 ,a21 )eR(21 )  implies  that 


Thus,  from  Table  1 


(7,7,7)p  >  (8,1 ,6)p. 


or  equivalently 


p2  —  “  0*2. 


A  summary  of  this  and  other  constraints  on  p  implied  by  conditions  associated 
with  the  second  stage,  is  presented  in  Table  2.  These  constraints  are  illu¬ 
strated  g-aph’'cally  ir  Figure  2;  the  darkened  region  *s  v.y  n0^e  that 
only  constraints  2,3,  and  6  are  necessary  to  describe  P2< 

The  above  analysis  indicates  that 


f2(21,p)  =  max  {(7,7,7)p,(5,5,9)p) 
A(21)  =  {(7, 7, 7), (5,5,9)}, 


.*  •  :■>, 
1  ■ .  . 


1  2 
••/here  (7,7,7)  is  associated  with  a^  and  (5,5,9)  is  associated  with 

1  2 

It  is  straightforward  to  show  that  a2-j  is  at  least  as  preferred  as  a2-j  if  and 


only  if  p2  >_  -p^+0.5.  Note  also  that 


f2(25,p)  *  max  {(7. 5, 3,1 .5)o,  (5,5,6)p>  *  (5,5,6)p, 


•'V-V-'J 


o  .> 

and  hence  A(25)  =  {(5,5,6)},  where  (5,5,5)  is  associated  with  a^.  We  note 

2  .  •- 

that  P?  is  a  subset  of  the  set  of  all  parameter  values  such  that  a25  is  at  least  aV 

c  S\W 

preferred  as  a^,  i.e.  the  set  of  all  p  such  that  p2  >_  -2.8p^+l  .8.  Thus, 
due  to  the  inequality  on  P  generated  by  the  statement  (a2g,a2j)eR(25) ,  it 


**.*«•' 
*  *  .  v*\. 
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also  follows  that  (a25,a25^e^^  and  hence  *7  is  at  least  as  preferred  as  *g. 

With  respect  to  stage  1,  note  that 

h(ll  ,p,a]rf2)  =  0.6f2{21,p)+0.4f2(22,p)  =  max  {(7.0,4.2,5.8)p,(5.8,3.0,7.0)p}. 

Also,  h(ll,p,a^,f2)  =  (6 ,3,2)p.  Since  (7. 0,4. 2, 5. 3)  >  (6,3,2),  a]1  is 

o 

always  at  least  as  preferred  as  a^ ;  therefore, 

f-l (11  ,p)  =  max  {(7. 0,4. 2, 5. 8) p, (5. 8, 3.0, 7. 0)p} 

and  at  least  one  of  the  strategies  1^,  i*2,  and  is  at  least  as  prel erred  as  ir^. 
Mo  new  information  about  the  value  of  the  imprecisely  known  parameter  has 
been  obtained;  hence,  P. |  = 

With  respect  to  stage  0,  note  that 

h(01  ,p,aQ-|  »f^)  =  0.5f1(ll  ,p)+0.5f1(12,p)  =  max  {(4. 5,4.1 ,5.9)p,(3.9,3.5,6.5)p>, 

h ( 01  ,p ,aQ-| , f-j )  =  0. 6^(13, p)+0. 4^(14,?)  =  (5.0,7.0,3.6)P 
3 

h(01,p,aQ1  ,t'i)  -  15 ,5 ,1 ) p . 

Observe  that  since  (5, 7, 3. 6)  >.(5,5,1),  the  statement  (a^  ,a^ )eR(01 )  is 

uninformative  with  respect  to  further  reducing  the  set  of  possible  parameter 

1  3 

values.  We  see  that  (ag-j  ,ag-j  )eR{01)  is  equivalent  to 

max  {(4. 5,4.1 ,5.9)p ,(3.9, 3.5,6. 5)p}  >  (5,5,l)p. 

The  set  of  all  p  satisfying  the  above  inequality  is  the  union  of  the  set  of 
all  p  satisfying  at  least  one  of  the  following  two  inequalities,  both  easily 
derived  from  the  above  inequality: 
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P2  <.  -0.93p1  +0.84 
P2  £  -0.94p.j  +0.79. 

The  union  is  described  by  the  first  of  these  two  inequalities  and  has  no  ■; 

effect  on  the  set  of  possible  parameter  values.  Thus,  Pg  =  P2* 

The  set  of  all  values  of  p  such  that  ag-j  is  at  least  as  preferred  as  a^-,  is  4 


’Ol 


set  of  all  p  such  that 


max{(4.5,4.1 ,5.9)p ,  (3.9,3.5,6.5)p>  £  (5.0,7.0,3.6)p . 


This  (nonconvex)  set  is  the  union  of  all  p  that  satisfy  at  least  one  of  the 
following  two  inequalities: 


p2  1  -0.539.p-j  +  0,44  “ 

P2  £  -0.625p-j  +  0.45. 

1  2 

Observe  that  this  set  contains  Pg.  Therefore,  ag-j  is  least  as  preferred  as  a^  f<£ 
all  pePg,  and  hence  at  least  one  of  the  strategies  tt-j  through  tt,.  is  at  least  as  pre 

ferred  as  each  of  the  strategies  Hg  through  Hg.  We  have  already  determined 

that  of  the  first  five  (5)  strategies,  only  strategies  it-j  and  n2  may  be 

% 

optimal.  We  therefore  conclude  that  the  set  of  all  possibly  optimal  S 

strategies  is  PQ  =  P2,  and 

fg ( 01  ,p)  =  max{(4.5,4. 1 ,5.9)p ,( 3.9 ,3.5 ,6.5)p} . 

We  remark  that  the  set  of  all  possibly  optimal  strategies  may  not 
*  * 

contain  the  strategy  *  ,  where  it  is  such  that 


min  fg  (01  ,p)  ^min  fg(01 ,p) 
peP0  pePo 

for  any  other  strategy  n  and  where  fg(01,p)  is  the  expected  utility  accrued 
by  strategy  tt  given  parameter  value  p.  We  first  note  that  fg(01,p)  can  be 
determined  by  the  dynamic  programming  equation  and  boundary  condition 

fk(sk«p)  =  (sk^,fk+l^ 

fK(sK,p)  —  u  (s^)  t  u  (sK)p  . 

The  values  of  the  fg(01,p)  are  presented  in  Table  3.  The  values  of  the 
criterion  for  each  n  of  the  linear  program 

min  f£(01 ,p) 
pcPQ 

★  • 

are  also  presented  in  Table  3,  indicating  that  u  =  .  Further  discussion 

of  this  type  ot  objective  in  a  mo^e  general  context  car  be  found  in  (White 
and  El  Deib,  1982) . 
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CONCLUSIONS 


We  have  presented  and  analyzed  a  generalization  of  the  standard 
decision  analysis  model  of  sequential  decisionmaking  under  risk. 

The  form  of  the  information  assumed  to  be  available  a  priori  and  the  problem 
objective  have  been  generalized.  We  have  only  assumed  that  the  vector  of 
utilities  is  a  member  of  a  given  set  rather  than  requiring  it  to  be  known 
precisely.  We  have  also  assumed  that  a  relation  on  the  set  of  available 
alternatives  is  given  for  each  decision  node.  The  problem  objective  has 
been  generalized  to  include  the  determination  of  all  possibly  optimal 
strategies  and  the  determination  of  the  set  of  all  possible  utility  values. 

We  have  noted  that  the  standard  decision  analysis  problem  and  the  inverse 
decision  analysis  problem  represent  special  cases  of  the  problem  presented 
here.  A  numerical  procedure,  illuminated  by  a  numerical  example,  has  been 
developed  to  satisfy  the  problem  objective.  One  other  problem  objective 
was  considered  within  the  context  of  the  numerical  example,  the  determi¬ 
nation  of  a  strategy  that  maximizes  the  minimum  expected  utility  to  be 
accrued,  where  the  maximum  is  with  respect  to  the  set  of  all  strategies 
and  the  minimum  is  with  respect  to  the  set  of  all  possible  parameter  values. 

A  currently  outstanding  question  is  how  to  cope  with  the  situation  where 
Pq  =  4>.  If  PQ  -  <f>,  then  the  relations  are  ranking  a  dominated  strategy 
higher  than  a  strategy  that  is  dominating  the  first  strategy.  Such  a 
situation  indicates  that  at  least  one  inconsistency  exists  between  the 
relations  and  P  and/or  the  problem  structure  is  fundamentally  inaccurate. 
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Region  of  Parameter  Imprecision 
After  Stage  2  for  Example  Problem 


f3(301,o)  =  (10,10,10)p 
f 3(301 ,p)  -  (  0,  0,  0 ) p 

f3(303,p)  =  (  5,  5,  9)p 

f3(304,p)  =  (  3,  7,10)p 

f3(315,p)  =  (  8,  1,  6)p 

f3(305,p)  =  {  7,  0,  4)p 

f3(307,p)  =  (  6,  3,  2) p 

f3(308,PJ  =  (  2,  4,  6)p 

f3(309,p)  =  (  7,  4,  3)p 

f3(310,p)  =  (  8,  2,  0)p 

^3 (31 1 jp)  =  (  5,  5,  6 ) p 

f3(312,p)  -  (  0,  5,  5)p 

f3(313,p)  -  (  4,  8,  0)p 

f3(314,p)  =  (  5,10,  0)p 

f3(315,p)  =  (  5,  5,  1)p 


h(21,p,a^,f3)  =  (7,7 ,7}p 

h(21,p,a^,f3)  =  (5,5,9}p 
h(21,p,a|ltf3)  =  (3,7,10)p 
h(21,p,a^,f3)  =  (8,1 ,6)  p 
h(22,p,a,f3)  =  (7,0 ,4)p 

h(23,p,a,f3)  =  (6,3,2)p 

h(24,p,a,f3)  =  (2,4,6)p 

b(25,p,*J5,*3)  =  (7.5 .3,1 .5lp 

h(25,P,a^5,f3)  =  (5,5,6)p 
h(25,p,a|5,f3)  =  (0,5, 5)o 
h(25,p,a^5,f3)  =  (4,8,0)p 
h(26,P,a,f3)  =  (5,10 ,0)p 

h(27,P,a,f3)  =  (5,5,1 )p 


TABLE  1:  Boundary  Conditions  and  h  Function 

Values  at  Stage  2  for  Example  Problem. 


l  -:  ;  -• 


(a2i >a2i)£^(2T) 

(all *a21 )eR(21)  <=> 

( a2i  >a2i)£R(21)  <=> 

(a25’a25)eR(25)  <-> 
(a25’a25)eR(25)  <==> 
(a25’a25)eR(25)  <=^ 


P2  1  0.4p1  -  0.2 

p2  1  3pi  ”  1 

P2  1  6.0p^  -  3.0 
p2  ^  -7.3p^  +  2.3 

p2  1  4*0pi  +  1 *0 

P2  1  -1  - 1 25p  -j  +  0.625 


TABLE  2:  Constraints  on  the  Parameter  from 

the  Second  Stage  for  Example  Problem. 


Note  that  the  preference  information  contained  in  the  R  sets  indicates  that: 


1. 


at  least  one  of  the  5  strategies  tt-j  ,  ir2,  ^3*  *4*  ^5  1S  more 

1  3 

preferred  than  it10  ((ag-|  .a^eRtO!)) , 


2.  at  least  one  of  the  4  strategies  Hg,  itg,  and  Hg  is  more  pre¬ 
ferred  than  *10  ((ag1,aQ1)eR(01)), 

3.  u-|  is  more  preferred  than  ^((alj  .a^-j ) eR(21 ) ) , 

2  3 

4.  ng  is  more  preferred  than  ^((a?!  »a2i ) eR( 21 )) , 

5.  tt g  is  more  preferred  than  ^((a^  .a^-j ) eR( 21 ) ) , 

1  3 

6.  ng  is  more  preferred  than  ^{(a^g ,a25)eR(25) ) , 

2  3 

7.  tt  1  is  more  preferred  than  TTg((a2g,a2g)eR(25)) , 

8.  ttq  is  more  preferred  than  Hg((  a^5,a^5)eR(25)). 

Strategies  -n-^ »  ^  "g»  "g.  and  q  are  therefore  eliminated  as  contenders 
for  most  preferred. 

Soundary  conditions  and  the  values  of  the  h  functions  at  stage  2  are 
presented  in  Table  1.  Recall  that  (a^  ,a2-j)eR(21 )  if  and  only  if 


b(21  ip(a«,  »f-j)  ^  h ( 21  » p  »api  if-}) . 


INTRODUCTION 

The  standard  decision  analysis  model  of  sequential  decisionmaking 
under  uncertainty  (Keeney  and  Raiffa,  1976).  assumes  that  the  decision  tree, 
fact  information  in  the  form  of  probabilities,  and  preference  information 
in  the  form  of  utilities  are  known  precisely-.  Given  such  structural  and 
parameter  value  information,  the  decision  analysis  paradigm  provides  an 
optimal  strategy,  i.e.,  a  best  alternative  to  select  at  each  decision  node 
in  order  to  maximize  expected  utility. 

In  reality,  utilities  and  probabilities  may  be  difficult  to  precisely 
assess  due  to,  for  example,  the  time  and  stress  associated  witK  their 
assessment.  Furthermore,  the  decisionmaker  may  be  willing  and  able  to 
directly  provide  information  about  the  relative  desirability  of  the  avai¬ 
lable  alternatives  for  at  least  some  of  the  decision  nodes  in  the  tree;  e.g 
a  physician  may  be  willing  and  able  to  directly  and  intuitively  express  a 
preference  for  selecting  diagnostic  test  A  over  diagnostic  test  B  in  diag¬ 
nosing  patients  having  a  specific  collection  of  signs,  symptoms,  and  labo¬ 
ratory  test  results.  Thus,  the  irput  assumptions  associated  with  the 
standard  decision  analysis  model  may  be  sufficiently  demanding  to  act  as 
a  barrier  to  the  acceptability  of  the  decision  analysis  paradigm  and  yet 
may  ignore  readily  available  information  that  could  be  of  significant  value 
in  strategy  selection. 

In  this  paper,  we  assume  that  the  decision  tree  is  given  and  that  all 
probabilities  are  known  precisely,  lie  then  diverge  from  the  aforementioned 
input  assumptions  for  the  standard  decision  analysis  model  by  assuming  that 
the  utilities  may  be  imprecisely  described  by  set  inclusion  and  that  a 
(possibly  null),  relation  on  the  set  of  all  available  alternatives  is  given 
for  each  decision  node.  Set  inclusion  has  been  selected  as  a  model  of 


parameter  imprecision  due  to  its  simplicity  and  behavioral  justifiability; 
see  Fishburn  (.1965),  Sarin  (.1 977a , b) ,  and  White  et  al ,  ('1982a)  for  further 
discussion.  The  intent  of  the  relations  is  to  model  the  decisionmaker's 
directly  expressed  preferences  among  the  available  alternatives  at  each 
decision  node.  We  then  develop  an  analytic  procedure  for  determining: 

(i)  the  set  of  all  strategies  that  may  be  optimal,  and 

(ii)  the  set  of  all  values  that  the  utilities  can  take. 

This  analytic  procedure  serves  as  the  basis  of  a  numerical  procedure  that 
is  a  generalization  of  results  presented  in  (White  and  El  Deib,  1982), 

We  rote  that  ?  symbiotic  relationship  exists  between  t.he  given  set  of  all 
utility  values  and  the  given  relations  associated  with  the  decision  nodes  in  that: 

(i)  information  contained  in  the  relations  tend  to  shrink  the  set 
of  all  possible  utility  values,  and 

(ii)  the  set  of  all  possible  utility  values  tends  to  increase  the 
number  of  pairwise  elements  in  the  relations. 

The  problem  formulation  to  be  examined  includes  two  interesting  cases: 

(i)  the  standard  decision  analysis  model  of  sequential  decision¬ 
making;  i.e.,  the  case  where  the  utilities  are  described  precisely 
and  where  all  relations  are  null, 

(ii)  the  inverse  decision  analysis  problem;  i.e.,  the  case  where  the 
utilities,  or  some  aspect  of  the  utilities  such  as  importance 
weights,  are  unknown  and  where  the  relations  are  sufficiently 
discriminating  to  provide  an  optimal  strategy. 

We  remark  that  the  output  of  the  inverse  decision  analysis  problem  is  the  set 

of  all  utilities  that  permit  the  given  strategy  to  be  optimal. 

A  variety  of  researchers,  e.g.  Fishburn  (1965),  Sarin  (1977a, b).  White 
et  al.  (1982a, b),  have  recognized  that  for  the  single  decision  node  case,  precise 
parameter  value  information: 
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(i)  may  represent  a  barrier  to  the  use  of  decision  analysis,  and 

i 

(ii)  may  not  be  necessary  to  determine  what  strategy  ranking 
information  is  required  for  strategy  selection. 

This  research  has  been  extended  to  the  sequential  case  by  Vlhite  and  El  Deib 
(1982).  The  problem  determining  the  set  of  all  parameter  values  for  which 
a  given  strategy  is  optimal,  the  inverse  control  problem,  has  been  examined 
in  a  variety  of  contexts;  e.g.,  control  theory,  (Casti,  1980),  mathemati¬ 
cal  programming  (Bitran  et  al.,  1981)  and  decision  analysis  (White  et  al., 
1982c).  The  research  to  be  reported  here  therefore  represents  an  extension 
of  the  results  presented  in  (White  and  El  Deib,  1982)  and  (White  et  al., 
1982c) . 

This  paper  is  outlined  as  follows.  The  generalized  sequential  decision 
analysis  model  is  formulated  in  Section  II  and  analyzed  in  Section  III.  A 
numerical  example  is  presented  in  Section  IV.  Conclusions  are  discussed  in 
the  final  section. 
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Abstract.  Often  there  exists  one  or  more  information  items  believed  rele¬ 
vant  but  not  fully  definitive  to  allow  error  free  diagnosis  of  the  state  of 
the  environment.  The  process  of  extracting  the  (maximum  amount  of)  infor¬ 
mation  concerning  the  state  of  the  environment  and  the  effect  of  various 
decisions  or  actions  is  called  inference.  Bayes'  theorem  yields  an  optimum 
procedure  for  the  sequential  aggregation  of  information  across  the  indepen¬ 
dent  samples  of  Information  for  cases  in  which  it  is  possible  to  Identify  a 
mutually  exclusive  and  exhaustive  set  of  hypotheses  about  the  state  of  the 
environment.  An  investigation  of  the  use  of  state  variable  concepts  for 
sequential  inference  analysis  with  dependent  multicue  information  in 
possible  nonstationary,  that  is  changing  over  time,  environments  is 
described.  The  central  object  of  the  research  is  to  develop  extensions  to 
the  theory  of  hierarchical  inference  in  large  scale  decentralized  systems 
that  will  allow  better  use  of  inference  analysis  in  operational  planning 
and  decision  support  settings.  To  these  ends,  the  concluding  section  of  this 
paper  describes  a  possible  use  of  hierarchical  inference  structures  as 
structured  protocols  for  communication,  command,  and  control  system  design. 
These  protocols  allow  identification  of  various  forms  of  cognitive  bias,  and 
appropriate  debiasing  procedures,  in  the  formulation,  analysis,  and  inter¬ 
pretation  of  various  information  and  judgment  inputs  to  decisionmaking. 


I.  INTRODUCTION 

For  maximum  efficiency  and  effectiveness, 
available  planning  and  decision  support 
resources  must  be  allocated  and  coordinated 
in  space,  over  a  hierarchy  of  decisionmakers, 
and  in  time,  as  new  information  arrives  and 
the  environmental  situation  extant  changes. 
Associated  information  acquisition,  process¬ 
ing,  and  evaluation  typically  must,  as  a  con¬ 
sequence,  be  distributed  both  in  space  and  in 
time.  Information  acquisition,  processing, 
and  evaluation  must  be  accomplished  selectiv¬ 
ely  in  space  and  time  since  different  deci¬ 
sionmakers  have  different  information  needs. 

In  addition,  it  will  be  physically  impossible 
and  behaviorally  undesirable  to  supply  all 
relevant  information  in  a  planning  and  deci¬ 
sion  support  system  to  each  decisionmaker  in 
the  hope  that  it  will  be  effectively  cognized 
and  utilized.  Further,  differences  in  educa¬ 
tion,  motivation,  familiarity  with  the  en¬ 
vironmental  situation  extant,  .md  stress  will 
ini luencc  cognitive  information  processing 
style.  Consequently,  a  central  task  in  the 
design  of  effective  systems  is  that  at  selec¬ 
tion  and  choice  of  appropriate  information 
system  architecture  to  enhance  selective  in¬ 
formation  acquisition,  processing,  and  evalua¬ 
tion  at  the  most  appropriate  time.  Thus, 
questions  of  information  selection.  Informa¬ 
tion  aggregation  In  space  and  In  time,  and 
the  contingency  task  structure  which  is  a 


function  of  the  environment  and  the  decision¬ 
makers,  become  of  major  importance. 

As  is  true  with  systems  engineering 
[1-4]  efforts  generally,  the  structural 
components  of  a  decision  support  system  (DDS) 
consist  of  adjuvants  for  Issue  formulation, 
analysis,  and  interpretation.  As  a  conse¬ 
quence,  an  issue  formulation  adjuvant  will 
enable  decisionmakers  to  acquire,  process, 
and  evaluate  information  in  order  to 
perceive  the  current  state  of  the  environ¬ 
ment;  to  compare  that  perception  with  a 
desired  state;  and  to  identify  possible 
action  alternatives  which  might  cause  the 
environmental  state  extant  to  change  such  as 
to  be  more  In  conformity  with  a  desired 
environmental  state.  The  issue  analysis 
adjuvant  will  enable  acquisition,  processing, 
and  evaluation  of  information  such  as  to 
allow  determination  or  analysis  of  the  im¬ 
pacts  of  the  proposed  action  alternatives  in 
terras  of  environmental  state  changes.  Fin¬ 
ally  the  interpretation  adjuvant  will  allow 
valuation,  in  accordance  with  a  value  system, 
of  the  identified  action  alternatives  in  terras 
of  their  impacts  upon  the  environment  such  as 
to  enable  selection  of  one  or  more  ot  the  pro¬ 
posed  action  alternatives  for  deployment  or 
impiementat  ton. 

A  variety  of  questions  make  design  and 
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application  of  the  aforementioned  adjuvants  a 
non  routine  task.  Perhaps  central  among  these 
questions  and  concerns  is  the  fact  that 
decisionmakers  may  differ  considerably  in 
their  education,  motivation,  and  prior  exper¬ 
ience  with  particular  operational  environment 
conditions  extant.  Whether  a  formal  opera¬ 
tional  style  or  concrete  operational  style  of 
cognition  is  appropriate  for  a  particular  con¬ 
tingency  task,  and  whether  or  not  this  will  be 
used,  is  strongly  dependent  upon  these  factors 
and  the  type  of  stress  that  they  produce. 
Automated  aids  must,  consequently  be  flexible 
in  the  sense  of  being  capable  of  adaptation  to 
a  variety  of  information  processing  and  judg¬ 
mental  styles  that  are  difficult  to  specify  a 
priori. 

Expert  decisionmaking  is  typically  done 
in  a  concrete  operational  mode  of  cognition, 
and  involves  use  of  one  or  more  of  a  variety 
of  judgmental  heuristics  including: 

.  reasoning  by  analogy 
.  standard  operating  procedures 
.  pure  intuitive  affect 
.  incremental  adjustment 

These  decision  styles  are  doubtlessly  appro¬ 
priate  for,  and  potentially  capable  of  ex¬ 
cellent  results  in, environments  where  the 
decisionmakers  diagnosis  of  situationally 
caused  stress,  and  when  other  components  of 
the  contingency  task  structure,  are  appro¬ 
priate  for  these  forms  of  concrete  operation¬ 
al  behavior.  In  unstructured  situations  in 
unfamiliar  environments,  a  formal  operational 
mode  of  cognition  is  generally  appropriate. 

One  task  of  an  automated  decision  support  sys¬ 
tem  is  to  assist  in  acquiring  the  experience 
and  situational  familiarity  appropriate  for 
cognizing  the  formal  operational  thought  pro¬ 
cess  into  a  situation  where  concrete  opera¬ 
tional  thought  is  efficient,  effective,  and 
otherwise  appropriate.  Concrete  operational 
thought  typically  involves  use  of  forward  pro¬ 
cessed  judgmental  heuristics  based  upon  a 
perceptive  mode  of  information  processing.  It 
is  the  preferred  cognitive  style  when  and  if  it 
is  "fully  appropriate"  for  information  pro¬ 
cessing  and  judgment.  Inferior  cognition  and/ 
or  poorly  perceived  concrete  environmental 
situations  may,  however,  result  in  a  combina¬ 
tion  of  information  processing  biases,  poor 
judgment.il  heuristics,  and  value  incohercncics 
which  nay  result  in  extremely  poor  use  of  in¬ 
formation  and  poor  aggregation  of  facts  and 
Values,  perhaps  accomplished  intuitively,  to 
form  judgments.  Extraordinarily  poor  concrete 
operational  thought  and  associated  judgment 
may  well  be  the  result  of  these  maladies 
which  may  be  very  effectively  reinforced 
through  feedback. 

Thus  it  is  desirable  tb.it  an  aooro- 
priately  designed  automated  aid,  or  adjuvant, 
for  planning  and  decision  support  systems  be 
capable  of: 

.  assisting  in  the  evaluation  ol  alter¬ 
native  plans  and  courses  or  action 
that  involve  tornal  operational 
thought  processes, 

.  assisting  in  the  transfer  of  formal 
operational  situations  to  concrete 


operational  situations, 

.  assisting  in  evaluation  of  alternative 
plans  and  courses  of  action  that 
involve  concrete  operational  thought 
processes , 

.  assisting  in  the  avoidance  of  informa¬ 
tion  processing  biases  and  poor 
judgmental  heuristics, 

.  assisting  in  the  use  of  variety  of 
judgmental  heuristics  appropriate  for 
given  operational  environments  as 
natural  extensions  of  a  decisionmaker's 
normal  cognitive  style, 

.  assisting,  to  the  extent  possible,  in 
the  determination  of  whether  a  formal 
or  concrete  style  of  cognition  is  most 
appropriate  in  a  given  situation, 

.  assisting  decisionmakers  who  need  to 
use  formal  operational  thought,  and 
those  whose  expertise  allows  appro¬ 
priate  and  effective  use  of  concrete 
operational  thought,  to  function  to¬ 
gether  in  a  symbiotic  and  mutually 
supportive  way. 

Clearly  there  is  a  space-time  dependency 
associated  with  these  desired  capabilities. 

Also  among  the  many  concerns  that  dic¬ 
tate  needs  and  requirements  for  automated 
decision  support  systems  is  the  fact  that 
more  judgments  and  associated  decisions  must 
be  made  in  a  given  period  of  time  than  can 
be  comfortably  made.  This  creates  a  stress¬ 
ful  situation  which  can  lead  to  the  use  of 
poor  information  processing  and  judgmental 
heuristics,  especially  since  judgments  and 
decisions  are  typically  based  on  forecasts 
of  the  future.  A  certain  level  of  stress  is 
also  necessary  for  optimal  information  pro¬ 
cessing  and  decisionmaking. 

An  "obvious"  aid  to  judgment  and 
decision  making  consists  of  using  optimi¬ 
zation  based  approaches.  It  is  easily  shown 
that  a  multistage  stochastic  decision  and 
control  framework  is  "proper"  in  these  situa- 
tiosn.  Even  more  proper  would  be  the  use  of 
decentralized  hierarchical  procedures  to 
cope  with  the  space-time  distributed  nature 
of  the  problems. 

Unfortunately  there  exists  potentially 
serious  problems  associated  with  the  use  of 
substantively  "optimum"  procedures  in  many 
typical  decision  situations.  A  time  in  the 
future,  or  planning  horizon,  must  be  speci¬ 
fied  before  problem  solution,  using  precise 
optimization  techniques,  is  begun.  In 
effect  a  "two  point  boundary  value  problem” 
must  be  solved  even  though  the  presentation 
format  used  lor  solution  display  may  not  make 
this  f ii  1 1  v  evident.  The  "folding  back"  pro¬ 
cedure  associated  witli  many  multistage 
decision  analysis  procedures,  in  which  the 
decision  situation  is  analyzed  backwards  in 
time  from  the  terminal  time  to  the  starting 
time,  represents  the  equivalent  oi  the  back¬ 
ward  sweep  procedure  necessary  to  solve  a  two 
point  boundary  value  problem  of  dynamic  opti¬ 
mization  theory.  Another  major  problem  with 
this  procedure  is  that  there  is  no  useful  pro¬ 
duct  until  the  entire  effort  is  completed. 


As  a  consequence,  one  of  several  approaches 
which  sacrifice  substantive  optimality,  that 
is  in  practice  often  unobtainable,  are 
often  used. 

Not  only  is  there  a  need  to  solve  problems 
over  a  particular  planning  horizon,  but  it  is 
often  necessary  to  update  the  resulting  solu¬ 
tions  "periodically"  as  better  information  is 
obtained.  Thus  it  is  necessary  to  cope  not 
only  with  planning  horizons  and  the  need  to, 
in  effect,  solve  two  point  boundary  value 
problems  backwards  in  time;  but  it  is  also 
necessary  to  update  solutions,  or  recommended 
alternative  courses  of  actions,  at  various 
planning  periods.  To  do  this  in  a  "substan¬ 
tively  optimum"  fashion  would  require  solution 
of  a  new  two  point  boundary  value  problem  at 
each  planning  period  with  processing  of  the 
new  state  change  and  value  change  information 
that  has  been  obtained  since  the  last  update. 

These  difficulties  are  further  confounded 
with  space  and  multiple  decisionmaker,  and 
related  organizational  issues;  with  the  cogni¬ 
tive  style,  experience,  and  contingency  task 
structure  related  determinants  of  human  infor¬ 
mation  processing  and  judgmental  mechanisms; 
and  with  potential  information  processing  bias 
and  judgment  heuristics. 

Thus  we  see  that  there  are  indeed  formid¬ 
able  needs  and  issues  to  be  resolved  that  are 
associated  with  the  design  of  information 
processing  and  judgment  aiding  support  sys¬ 
tems.  These  relate  to  questions  concerning 
appropriate  functions  for  the  decisionmaker 
and  staff  to  perform.  They  concern  the 
type  of  information  which  should  be  avail¬ 
able  and  how  this  information  should  be 
acquired,  processed,  stored,  aggregated  and 
presented  such  that  it  can  be  used  most 
effectively  in  a  variety  of  potential  opera¬ 
tional  environments.  They  concern  design  of 
information  systems  with  strong  space-time 
environmental  dependencies.  They  concern 
design  of  information  systems  that  can 
effectively  "train"  decisionmakers  to  adapt 
and  use  appropriate  concrete  operational 
heuristics  in  those  environments  in  which 
inexperience  dictates  initial  use  of  formal 
operational  thought.  They  concern  design 
and  use  of  information  systems  that  support 
environmentally  experienced  decisionmakers 
in  che  use  of  a  variety  of  effective  concrete 
operational  heuristics.  And  because  of  use 
of  decision  support  systems  by  multiple 
decisionmakers,  these  tasks  must  be  accom¬ 
plished  in  a  parallel  arclti  ti’eturu  1  fashion. 

Structure  is  vitallv  important  in  each 
of  the  steps  of  i  systems  engineering  effort 
[ J—  7 J .  There  are  a  number  of  structural 
models,  generally  in  tile  lorm  of  a  tree, 

Chat  are  very  useful  lor  tile  analvsis  and 
interpretation  steps,  including  models: 

(U  of  the  objectives  or  of  the  attri¬ 
butes  which  proposed  policies  or 
decisions  should  sutisty.  This 
structure  is  generally  called  an 
objectives  tree  or  an  attribute 
tree  [  1-7]. 


(2)  of  the  impacts  on  aleatory  states 
of  nature  of  proposed  action  alter¬ 
natives,  policies  or  decisions. 

This  structure  is  generally  called 
a  decision  tree  or  decision  dia¬ 
gram  [3,8]. 

(3)  of  the  way  in  which  inferences 
about  the  state  variables,  or 
states  of  nature,  and  influenced 
by  information  and  observable 
events  [5,6,8].  This  structure  is 
generally  called  an  inference  or 
influence  tree,  or  inference  dia¬ 
gram  [9]. 

This  paper  reports  on  research  that 
extends  previous  efforts  concerned  with 
hierarchical  policy  and  decision  analysis, 
studies  in  large  scale  systems.  To  what  is 
believed  are  some  interesting,  unsolved 
and  application  relevant  issues  involving 
hierarchical  inference.  Our  efforts  involve 
the  mathematical  concepts  of  systems  science 
and  operational  research;  integration  of 
these  with  organizational  human  and  behav¬ 
ioral  factors  concerns;  and  application  to 
information  processing  requirements  for 
planning  and  decision  support  in  systems 
engineering  and  large  scale  systems. 

II.  HIERARCHICAL  INFERENCE  STRUCTURES 

Hierarchical  inference  structures  are 
useful  in  decisionmaking  when  the  decision¬ 
maker  has  observed  available  data  and  wishes 
to  interpret  the  implications  of  the  data  when 
it  is  combined  with  prior  experience.  Let  us 
consider  that  the  decisionmaker  has  only  limi¬ 
ted  information  available.  More  is  accessible 
but  only  at  the  expense  of  an  incurred  cost. 

Two  options  available  to  the  decisionmaker  are 
maximum  likelihood  estimation  and  hypothesis 
testing.  In  the  former  the  decisionmaker 
attempts  to  obtain  and  utilize  information  to 
determine  which  decision  strategy  has  the  max¬ 
imum  likelihood  of  being  the  most  authentic  in 
the  sense  of  the  one  that  most  accurately  and 
fully  expresses  beliefs.  To  accomplish  hypoth¬ 
esis  testing,  the  decisionmaker  assigns  worth 
scores  to  each  of  the  information  items  and 
uses  the  likelihood  estimates  to  obtain  utili¬ 
ties  for  each  strategy.  If  the  decision¬ 
maker  is  rational,  the  hypothesis  that  maxi¬ 
mizes  espected  utility  is  selected  and  assumed 
correct. 

in  the  initial  phase  of  inference  analy¬ 
sis  the  alternate  decision  strategies  avail¬ 
able  to  the  decisionmaker  are  proposed,  ns  are 
the  state  or  activity  variables  s^  and  infor¬ 
mation  items  Vj.  Through  the  structuring  pro¬ 
cess,  these  elements  are  related  Co  form  a 
model  of  the  hierarchical  inference  structure, 
it  is  assumed  that  the  decision  strategies  are 
mutually  exclusive  and  exhaustive  and  th.it  the 
prior  probabilities  of  being  the  authentic 
strategy,  p(d.),  i=l,...,n,  are  selected  such 

that  they  sum  to  l,  and  that  D  =  id^.dl . d^; 

S 1  s  and  V  =.  tVi.V,....;  are 

discrete  and  finite.  We  also  require  indepen¬ 
dence  among  the  state  variables  at  .my  level  of 
the  structure.  Upon  completing  the  assign¬ 
ment  of  prior  probabilities  to  the  decision 
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strategies,  we  proceed  downward  into  the  authentic  probabilities.  Secondary  uncer- 

structure,  making  nominal  conditional  proba-  tainty  is  resolved  by  further  introspection 

bility  assessments  on  the  remaining  variables.  and  perhaps  computation  and  is  expressed  by 

The  encoding  of  the  nominal  probability  assign-  probabilities  based  on  partial  consideration 
ments  is  complete  when  the  probability  of  each  of  prior  experience. 


available  information  item  v,  conditioned  on 
the  state  and  decision  variables  has  been  Tha  use  of  experts  in  supplying  informa- 

determined.  The  structure  is  now  called  a  *i0n  *nd  c°nd^ional  probabilities  necessary 

deductive  hierarchical  inference  structure.  °  ™a.e.  an„ln  erer?!!-|  as  previously  been  pre¬ 

sented  by  Morris  L12J.  If  several  experts 
The  inductive  hierarchical  inference  are  used  and  a  joint  assessment  is  done, 

structure  is  formed  from  the  deductive  struc-  procedures  such  as  the  Delphi  approach  have 

ture  by  making  inferences  of  two  types:  proved  useful.  Also  considered,  though  with 

(k)  relating  a  conditional  probability  distri-  less  practical  success,  is  the  case  where 

bution  of  an  element  to  an  element  two  levels  multiple  experts  independently  assess  proba- 

higher,  and  (ii)  coalescing  several  conditional  bilities  but  where  the  decisionmaker  values 


probability  distributing  into  an  element  on 
which  they  are  conditioned.  The  algorithms 
for  doing  this  are: 

(i)  p ( vj  d,e)  =  Ip(v|  d,s,e)p(s  d,e)  (1) 
(ii)  p(s|  d,e)  =  np(s|  d,e)  (2) 


the  credibility  of  some  more  than  that  of 
others.  Here  redundancy  occurs  if  some 
experts  use  the  same  indicators  as  others. 
If,  however,  each  expert  uses  a  different 
indicator  and  if  opinions  of  experts  are 
similar,  the  decisionmaker's  confidence  is 


where  v  is  an  information  item,  d  is  a  decision  .  B“C  a  Problem  remains  with  encoding, 

. _  4.  .  .e.e.  and  that  is  how  to  elicit  nearly  authentic 


strategy,  s  is  a  state  variable,  e  is  prior 
experience,  and  where  p(  )  is  the  conditional 
probability  mass  function.  The  maximum  likeli¬ 
hood  estimate  of  the  authentic  decision 
strategy  is  obtained  using  these  algorithms 
and  an  application  of  Bayes1  rule. 

With  this  preliminary  inductive  inference 
structure,  a  conventional  sensitivity  analysis 
may  be  performed  to  determine  the  impact  of 
the  prior  probabilities  of  the  decision  strat¬ 
egies,  conditional  probabilities  of  the  state 
variables,  and  conditional  probabilities  of 
the  information  items  on  the  maximum  likeli- 


probabilities  from  experts. 

In  a  situation  where  there  do  not  exist 
any  experts  who  are  capable  and  willing  to 
assess  informational  probabilities  or  where 
no  direct  empirical  evidence  has  been  collec¬ 
ted,  it  is  possible  to  use  stochastic  simula¬ 
tion  modeling  to  generate  useful  and  needed 
conditional  probabilities.  This  may  be  prac¬ 
tical  when,  for  example,  there  is  knowledge 
available  or  understanding  of  the  dependence 
relationship  between  the  state  variables  and 
information  items.  Through  this  model  appro- 


cne  ini  urination.  xweuis  uu  uic  umaaiuuui  ..  , _ ,  ,  , 

.  .  ,  .  -  .  .  _  priate  conditional  probabilities  based  on 

hood  estimate  of  the  authentic  decision  strat-  relative  frequencies  be  generated  and 

egy.  When  a  maximum  likelihood  decision  strat-  encoded  for  use  as  infomational  items  in 

egy  is  relatively  unaffected  by  perturbations  .  .  .  ..  , 

67  ,  .  ,,  ,  maximum  likelihood  estimation, 

in  prior  probabilities,  state  variable  proba¬ 
bilities,  and  informational  probabilities,  then  The  incorporation  of  dynamics  into  the 

the  decisionmaker  gains  additional  confidence  decision  situation  structure  appears  poten- 
due  to  the  decision  strategy's  robustness.  tially  very  useful,  if  it  can  be  done  in  a 

If  the  number  of  decision  strategies  considered  reasonably  simple  way.  For  example,  in  prob- 
is  large,  then  the  posterior  probabilities  may  lems  with  a  long  time  horizon,  it  is  not 


offer  the  decisionmaker  flexibility  in  the 
sense  that  a  strategy  may  have  to  be  only 
nominally  altered  with  the  acquisition  of 
additional  information.  This  approach  to 


possible  to  expect  either  encoded  probabili¬ 
ties  or  utility  functions  to  remain  constant. 
The  concept  of  using  a  stochastic  simulation 
model  poses  other  interesting  questions. 


flexibility  in  decision  analysis  has  previous-  Whereas  the  expert  elicited  conditional 


ly  been  proposed  by  Merkhofer  [id].  if  this 
flexibility  condition  is  not  available,  then 
aleatory  variables  and  potent  decision  varia¬ 
bles  causing  this  may  be  readily  identified. 

When  performing  an  inference  analysis, 
wo  ittempt  to  describe  all  state  and  decision 
variables  relevant  to  the  problem.  Often 
achievement  of  m  ideal  model,  which  expresses 
accurately  our  uncertaintv  about  the  depon- 
de  ic,'  relationship  between  inf orn.it ion  items 
and  state  aid  decision  variables,  is  restric¬ 
ted  bv  economics  as  well  as  cognitive  bias 
and  limitations  ot  prior  experience.  lor 
•  imilar  reasons  uneorciir.tv  oi  the  conditional 
behavior  of  state  variables  exists.  Uncer¬ 
tainty  due  to  linite  considerations  oi  prior 


probabilities  are  direct  subjective  estimates, 
those  from  the  stochastic  model  are  also 
subjective,  but  in  this  case  indirect.  They 
are  related  to  the  conditional  probabilities 
through  the  model's  structure,  parameters, 
and,  possible  boundary  conditions. 

III.  INFORMATION  PROCESSING  STRUCTURE  AND 
BIASES 

We  describe  contemporary  research  inves¬ 
tigating  the  effects  of  various  structured  in¬ 
formation  process ing/dec is  ion  aiding  protocols 
upon  the  formulation,  analysis,  and  interpreta¬ 
tion  ot  information  md  its  integration  with 
judgment  and  derision  making  activities.  Our 
basic  information  lormul.it  ion,  analysis,  and 


experience  has  been  called  primary  uncertainty  interpretation  structure  will  be  based  upon 

due  to  incomplete  consideration  ot  prior  the  6  elements  found  in  expli.  it  argument  [lj]. 

experience  i.llj.  i’rinarv  uncertainty  Is  These  elements  are: 

resolved  only  by  obtaining  additional  Lnfor-  ,  ,  .  , 

nation  on  the  variables  and  is  expressed  by  1‘  g- — or  ''>'P°theses 


2.  grounds  or  foundations  to  support  the 
claims 

3.  warrants  or  justification  for  the 
grounds  or  foundations 

4.  backing  or  the  general  body  of  informa¬ 
tion  that  is  presupposed  by  the  warrant 

5.  modal  qualifiers  or  circumstances  con¬ 
tingencies  or  restrictions  which  will 
have  to  exist  in  order  that  the  warrant 
truly  supports  the  grounds 

6.  possible  rebuttals  or  circumstances, 
contingencies,  or  restrictions  which, 
if  they  exist  will  refute  or  diminish 
the  force  of  the  warrant. 

A  simplified  block  diagram  of  the  interaction 
among  these  elements  is  shown. 

The  information  processing  "structure" 
for  the  information  processor,  consisting 
in  part  of  the  decisionmakers  view  of 
possible  and  probable  action  courses  and  the 
"decision  situation  model",  is  specified  by 
elements  3-6.  Element  2,  the  "grounds",  com¬ 
prises  the  situational  data  pertaining  to  the 
operational  conditions  extant. 

Toulmin  shows,  through  examples,  that 
the  six  elements  for  logical  argument  and 
reasoning  can  be  used  as  a  model  for  rational 
reasoning  in  a  number  of  areas  including: 
law,  science,  the  arts,  management,  and 
ethics.  Clearly  it  will  apply  to  military 
intelligence  and  a  number  of  other  relevant 
areas  as  well.  This  structured  information 
processing  model  is  also  sufficiently  general 
to  accommodate  analytical  hierarchical  in¬ 
ference.  Thus  it  will  provide  a  structured 
framework  for  information  processing  that  can 
accommodate  a  variety  of  information  pro¬ 
cessing  styles  and  approaches  ranging  from 
the  purely  qualitative  and  affective  and 
quantitative,  to  quantitatively  based  fil¬ 
tering  and  detection  algorithms. 

Information  summarization  is  needed  in 
DSS  for  a  variety  of  reasons.  Huber  [ 14 ] 
and  Ceiselman  and  Samet  [l5]  discuss  the 
needs  for  information  summarization  and 
procedures  to  condense  and  organize  informa¬ 
tion  into  a  form  that  can  be  managed  and  used 
in  an  efficient  manner.  We  postulate  that 
the  structured  information  processing  model 
suggested  here  provides  organizational  sup¬ 
port  for  message  aggregation  and  integration 
th.it  will  accommodate  and  encourage  effective 
information  summarization.  Information  summ¬ 
arization  guidelines,  such  as  these,  can  be 
modeled  as  a  special  case  of  the  structured 
framework  presented  here  which  will  accommo- 
d  itu  both  receptive  and  preceptive  stylos  ol 
processing  and  summarization  of  information, 
and  which  will  also  icromnodaie  non  nuneric.il 
and  numerical  im  orra.it  i on,  thus  hopefully 
enabling  rapid  conversion  from  one  to  the 
other  is  needed  or  desired  in  different  con¬ 
tingency  task  structures.  Whether  iiuorn.i- 
tion  aumnar i ::.it ion  using  this  framework  is  a 
guideline  can  produce  more  useiiil  and  accu¬ 
rate  summaries  than 

this  framework  is  a  subject  currently  under 
investigation. 

The  recent  literature  discusses  many  of 


the  processing  biases  that  occur  during  for¬ 
mulation,  analysis  and  interpretation  of 
information  [l6-2l].  These  processing  biases 
include : 

Formulation  bias:  frequency,  base  rate, 
availability,  selective  perception,  con¬ 
crete  information,  spurious  cues,  spur¬ 
ious  correlations,  data  presentation, 
conservatism. 

Analysis  bias:  anchoring  and  adjustment, 
representativeness,  law  of  small  numbers, 
selective  perception,  hindsight,  a°d 
Interpretation  bias:  lexicographic  semi- 
orders  ,  wishful  thinking,  illusions  of 
control,  alterations  of  multi-stage 
decision  structure. 

These  biases  are  influenced  by  a  number 
of  factors;  with  stress  and  the  contingency 
task-structure  being  among  the  dominant  influ¬ 
ences.  Also,  there  are  a  number  of  feedback 
mechanisms  involved  which  influence  these 
biases . 

Use  of  structured  information  processing 
models,  such  as  the  model  for  reasoning  pre¬ 
sented  here,  will  allow  recognition  of  many  of 
the  biases  of  analysis  and  interpretation, 
and  debiasing  of  those  that  do  occur.  Infor¬ 
mation  formulation  biases  are  generally  due  to 
the  use  of  agenda  dependent  "editing"  or 
"framing"  rules.  It  is  on  the  basis  of  scen¬ 
ario  descriptions  and  summaries  that  Issues 
and  prior  statistics  for  information  pro¬ 
cessing  are  determined.  One  of  the  fundamen¬ 
tal  claims  of  prospect  theory  and  related 
theories  [16-21]  is  that  these  editing  or 
framing  rules  lead  to  agenda  dependent  infor¬ 
mation  formulation  and  related  information 
acquisition.  Knowledge  of  editing  rules  used 
in  a  given  situation  will  generally  allow 
determination  of  a  set  of  debiasing  proce¬ 
dures.  Various  structured  procedures  and 
protocols,  based  upon  a  set  of  required  speci¬ 
fications  to  determine  information  formulation 
needs  for  the  6  element  reasoning  model  dis¬ 
played  earlier,  should  serve  as  useful  adju¬ 
vants  to  the  effective  determination  of  "pro¬ 
per"  editing  rules  which  avoid  various  error 
formulation  biases. 

IV.  HIERARCHICAL  INFEREL^  \LGORITHMS 
AND  ISSUES 

In  a  very  large  number  of  contemporary 
areas,  there  arc  issues  involving  the  possi¬ 
ble  occurrence  of  uncertain-to-occur  events. 
Often  it  is  much  easier  to  determine,  by  a 
combination  of  subjective  elicitation  of 
appropriate  parties  at  interest  and  objec¬ 
tive  physical  measurement,  probabilities  and 
likelihoods  for  the  events  at  issue  if  they 
are  conditioned  upon  the  occurrence  of  other 
events  and/or  decisions.  This  appro. ich  forms 
the  basis  tor  cross  impact  .inalvsis,  hierar¬ 
chical  Imerence  analysis  and  other  related 
appro. idles  in  which  probability  structures  or 
probability  diagrams  have  proven  to  be  of  con¬ 
siderable  value. 

In  these  approaches,  it  is  jssum.od  that 
observed  information  can  be  directly  related 
to  postulated  hypotheses  and  that  the  Impact 


of  observed  information  on  the  probability 
of  a  given  hypothesis  being  true,  or  occuring, 
evolves  sequentially  according  to  Bayes  rule. 
The  complexity  of  many  contemporary  large 
scale  issues  is  such  that  the  amount  and  type 
of  cognitive  skills  and  technical  knowledge, 
required  to  express  all  appropriate  probabil¬ 
ities  or  likelihood  ratios,  which  infer  or 
link  all  information  elements  to  postulated 
hypotheses,  is  beyond  the  unaided  capability 
of  any  single  individual,  and  often  even  the 
aided  capability.  A  possible  approach  to 
ameliorate  this  situation  is  to  disaggregate 
the  complex  issue  into  a  hierarchical  struc¬ 
ture  and  to  determine  the  structure  and  para¬ 
meters  within  the  structure  [22].  In  the 
hierarchical  approach  to  information  struc¬ 
turing  and  associated  inference,  a  number  of 
intermediate  elements  are  identified.  These 
elemencs  typically  represent  activity  states 
or  activity  indicators  which  are  relevant  to 
the  postulated  hypotheses.  These  activity 
states  or  activity  indicators  are  presumed  to 
be  meaningful  representations  of  a  portion  of 
the  issue.  Probabilities  which  relate  ob¬ 
served  information  to  these  intermediate  ele¬ 
ments  are  assessed  or  elicited,  as  well  as  the 
probabilities  which  related  these  intermediate 
elements  to  the  postulated  hypotheses. 

The  rationale  behind  this  approach  is 
behaviorally  and  organizationally  compelling. 
Parties  at  interest  to  a  given  issue  may  be 
expert  in  diverse  portions  of  the  complete 
issue  and  a  single  individual,  or  group,  will 
probably  not  have  sufficient  experience  and 
knowledge  to  relate  lowest  level  information 
to  highest  level  hypotheses.  If  a  complex 
issue  is  hierarchically  decomposed,  it  may  be 
possible  to  utilize  the  abilities  and  know¬ 
ledge  of  various  groups  in  an  efficient  and 
logically  consistent  fashion.  Presumably, 
organizations  are  structured  in  a  hierar¬ 
chical  manner  to  take  advantage  of  oppor¬ 
tunities  such  as  these. 

There  is  no  unique  structure  for  a 
hierarchical  model  of  a  given  issue.  These 
models  are  necessarily  subjective  contingency 
structures  in  that  they  can  only  represent  a 
conceptual  model  of  a  particular  issue,  and 
the  w.iy  in  which  a  particular  issue  is  dis¬ 
aggregated.  The  influence  of  various  cogni¬ 
tive  styles  of  the  individual  or  group  con¬ 
structing  file  model  and  the  influence  of 
various  constraints,  such  as  environmental 
constraints,  are  generally  the  strongest 
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